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This  study  identified  and  developed  criteria  for  the  evaluation 
of  teacher  education  center  programs  in  compliance  vn'th  the  Teacher 
Education  Center  Act  of  1973.    The  study  involved  three  major  steps: 
(1)  the  conceptual  evaluation  plan,  (2)  the  status  report  based  on 
review  of  teacher  education  center  (TEC)  documents,  and  (3)  team 
visitation  to  TEC  sites. 

A  review  of  literature  on  the  evaluation  of  teacher  education 
centers  at  the  national  level  as  well  as  within  the  State  of  Florida 
indicated  a  need  for  the  development  of  criteria  for  the  evaluation 
of  TEC  programs.    The  development  of  criteria  was  based  on  the 
conceptual  framework  advocated  by  Stake  known  as  "responsive 
evaluation." 

The  examination  and  review  of  TEC  documents  in  relation  to  the 
status  of  evaluation  in  the  existing  TECs  indicated  a  heavy  emphasis 
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on  quantitative  rather  than  qualitative  assessments;  thus  the 
need  for  the  development  of  qualitative  measures. 

A  total  of  65  TEC  members,  representing  nine  different  role- 
groups:    (1)  teachers,  (2)  principals,  (3)  administrators,  (4)  TEC 
directors,  (5)  citizens,  (6)  college  professors,  (7)  school  board 
members,  (8)  DOE  representatives,  and  (9)  teacher  organization 
representatives  directly  participated  in  the  process  of  developing 
the  criteria.    Three  TECs,  selected  at  random,  were  visited  to  try 
out  the  proposed  criteria:    Alachua  TEC,  Northeast  TEC,  and  Polk 
County  TEC.    TEC  members  who  participated  helped  in  the  development 
of  qualitative  criteria  and  their  participation  facilitated  communica- 
tion and  understanding  among  and  between  the  groups  represented. 

The  set  of  criteria  developed  in  the  study  examined  the 
philosophy,  objectives,  and  functions  of  teacher  education  centers 
in  relation  to  the  intent  and  purpose  of  the  Teacher  Education 
Center  Act  of  1973.    Thirteen  criteria,  organized  into  four  sections, 
dealt  with  four  major  components  of  TEC  programs: 

Section  A     RATIONALE  FOR  TEC  EVALUATION 

1.  Statement  of  Policy 

2.  Regularity  in  Evaluation 

Section  B     EXTENT  OF  COLLABORATION  AND  PARTICIPATION 

3.  Collaboration 

4.  Participation 

5.  Role  Groups 

6.  Incentives 
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Section  C     DESCRIPTION  OF  PROGRAMS 

7.  Necessary  Activities 

8.  Achievement 

Section  D     ASSIGNMENT  OF  RESPONSIBILITY  AND  RESOURCES 

9.  Responsibility  for  Evaluation 

10.  Evaluation  Methods 

11.  Adequacy  of  Documentation 

12.  Adequacy  of  Resources  Available 

13.  Availability  of  Outside  Resources 

The  use  of  these  developed  criteria  should  enable  TEC  members 
to  reexamine  the  purposes  and  potential  of  TECs  in  Florida. 
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CHAPTER  I 
INTRODUCTION 


The  teacher  center  movement  in  the  state  of  Florida  represents 
a  significant  effort  to  improve  public  education  by  improving  the 
quality  and  availability  of  inservice  education.    To  improve  the 
quality  a  need  to  pay  "greater  attention  to  evaluation  process" 
carried  on  by  the  Teacher  Education  Centers  (TECs)  had  been  emphasized 
in  the  report  submitted  by  the  Florida  Department  of  Education  (DOE). 
In  it's  report,  the  DOE  recommended  that  "the  Commissioner  of 
Education  should  assign,  as  a  priority  activity,  the  development 
of  procedures  for  systematic  evaluation  of  teacher  education  center 
programs,  fulfilling  evaluation  functions  outlined  in  Florida 
Statutes"  (FTEC:    A  Review  of  Policy  and  Policy  Implementation, 
1977,  p.  57).    Consequently,  there  was  a  need  for  developing  qualita- 
tive procedures  and  criteria  for  evaluating  the  evaluation  activities 
to  be  undertaken  by  TECs  as  specified  in  Section  231.608  of  the 
Teacher  Education  Center  Act  of  1973.    This  study  had  been  designed 
to  meet  that  need. 

Problem  Statement 

The  purpose  of  this  dissertation  was  to  identify  and  develop 
criteria  which  could  be  used  in  the  evaluation  of  Teacher  Education 
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Center  programs  in  accordance  with  the  evaluation  process  specified 
by  the  "law. 

The  Statutory  provision  (Section  203.608,  F.S.),  requires 
that  each  teacher  education  center  shall  submit  an  annual  report 
to  the  State  Council  for  Teacher  Education  Centers.    This  report 
shall  be  based  on  the  measurable  objectives  of  the  center  proposal 
and  shall  include  but  not  be  limited  to  the  following: 

(a)  A  description  and  evaluation  of  programs  conducted 
under  the  supervision  of  the  center. 

(b)  The  number  of  participants  in  center  program  activities. 

(c)  A  description  and  evaluation  of  methods  of  center 
operations. 

(d)  A  statement  of  center  expenditures. 

For  this  purpose,  the  proposed  criteria  were  developed  exploring 
four  essential  areas  in  TEC  evaluation:    (a)  the  rationale,  (b)  the 
extent  of  collaboration  and  participation,  (c)  the  description  of 
programs  or  activities,  and  (d)  the  adequacy  and  availability  of 
resources . 

The  following  questions  were  examined  in  relation  to  the  four 
essential  areas,  while  developing  the  proposed  criteria: 

A:    What  efforts  have  been  made  to  evaluate  TEC  programs? 
What  is  the  rationale  for  TEC  program  evaluation? 

B:    How  are  decisions  made  in  TECs?    What  methods  or  incentives 
are  utilized  to  facilitate  participation  in  TEC  programs?    Who  are 
the  participants? 
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C:    What  activities  are  carried  out  to  achieve  the  intended 
goals  and  objectives  in  TECs?    Are  the  activities  and  programs 
being  implemented  as  intended?    Do  the  activities  conform  with 
those  of  the  required  law  (Section  231.603  (2)  F.S.)? 

D:    Who  is  responsible  for  evaluation  of  TECs?    What  methods 
are  used  in  evaluation  of  TEC  programs?    How  are  programs  judged 
(1)  by  those  who  are  involved  with  them,  (2)  by  those  who  have 
expertise  in  program  areas?    What  seems  to  be  the  ultimate  rationale 
in  their  judgment? 

Need  for  the  Study 

To  this  date,  there  have  been  no  standards  or  criteria  to 
determine  the  evaluative  efforts  of  teacher  education  centers. 
There  seems  to  be  a  need  for  qualitative  evaluation  criteria  rather 
than  quantitative  emphasis  on  TECs'  activities.    A  result  of  a 
research  survey  (Drummond,  Note  1)  indicated  that  the  directors  of 
TECs  needed  more  assistance  and  guidance  in  the  matter  of  program 
eval uation . 

To  date,  some  studies  had  been  conducted  in  attempts  to 
evaluate  Florida  Teacher  Education  Centers,  e.g..  Start  Up  Problems 
of  TEC  (Van  Fleet,  1977);  Laboratory  Training  for  TEC  (Barrett, 
1976);  and  Synthesizing  Analysis  of  Collaboration  (Reed,  1973). 

However,  none  had  devoted  complete  attention  to  the  evaluative 
efforts  and  the  need  for  criteria  to  be  utilized  in  the  process  of 
evaluation  by  the  TECs. 
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The  criteria  developed  through  this  study  could  provide  a 
basis  for  evaluation  of  TECs  in  existence  and  the  new  TECs  which 
may  join  the  expanding  mandatory  system  of  teacher  center  operations 
in  Florida. 

The  increase  in  the  popularity  of  the  teacher  education  center 
movement  appeared  to  be  a  national  as  well  as  a  Florida  phenomena. 
In  1976,  federal  monies  (Public  Law  94-482)  were  earmarked  for  the 
implementation  and  operation  of  new  teacher  education  centers.  The 
criteria  developed  through  this  study  could  be  made  available  as 
needed  to  all  the  teacher  education  centers  in  the  nation  through 
the  Teacher  Corps,  U.S.  Office  of  Education. 

Method  of  the  Study 

Nixon  (1973)  identified  two  basic  dimensions  that  are  important 
considerations  in  the  conducting  of  an  evaluation:    methodology  and 
people.    Of  these  two  dimensions,  "people"  was  without  question  the 
more  demanding  of  considerations.    According  to  him,  it  is  the  people 
who  determine  values  and  who  set  standards.    Keeping  in  mind  this  con- 
sideration, this  study  examined  the  goals,  values,  and  criteria,  if 
any,  set  by  the  local  TEC  council  members  and  the  state  TEC  council 
members  in  their  efforts  for  evaluation  of  TECs.    For  this  purpose, 
a  layout  of  statements  and  data  were  collected  using  the  Data  Matrices* 
devised  by  Robert  Stake  (1977)  for  "responsive  evaluation." 

*The  development  of  criteria  and  design  of  study  are  described  in 
detail  in  Chapter  III. 
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Definitions  of  Terms 

Center:    The  headquarters  location  and  the  preservice  and  in- 
service  teacher  training  activities  carried  out  in  a  school  district 
in  a  teacher  education  center  as  approved  by  regulations  of  the 
State  Board  of  Education. 

Criteria:    Criterion,  the  singular  form  of  the  noun,  is  defined 
as  a  standard  of  judging.    It  is  a  rule  or  test  by  which  facts  and 
conduct  are  tried  in  forming  a  correct  judgment  respecting  them. 
Measure,  rule,  standard,  and  test  are  synonyms  for  criterion.  In 
this  dissertation  criteria  refer  to  the  developed  specifications 
from  the  law  to  be  applied  to  the  evaluation  process. 

Teacher:    All  professional  personnel  working  toward  an  educa- 
tional career  or  already  in  education,  including  school  administrators, 
supervisors,  counselors,  librarians,  and  others. 

Team  Visitation:    In  this  study  "team  visitation"  refers  to  the 
meeting  of  individuals  who  were  invited  to  a  TEC  site  to  discuss 
criteria  and  procedures  for  judging  the  adequacy  of  TEC  evaluation 
with  local  TEC  council  members. 

Limitations 

This  study  was  limited  to  only  those  Teacher  Education  Centers 
in  Florida  which  were  established  under  the  Teacher  Education 
Center  Act  of  1973,  between  the  period  of  1974-1979  (see  Appendix 
A-1). 


CHAPTER  II 
REVIEW  OF  RELATED  LITERATURE 


To  determine  the  advisability  of  developing  criteria  for 

evaluation  of  teacher  education  center  programs,  literature  was 

reviewed  pertinent  to  (a)  conceptual  views  on  program  evaluation, 

(b)  teacher  education  center  development,  and  (c)  evaluation 
efforts  in  TECs. 

Conceptual  Views  of  Program  Evaluation 

Program  evaluation  is  a  process  by  which  relevant  data  are 
collected  and  transformed  into  information  which  can  be  used  for 
decision-making.    Cahen  (1971)  defines  evaluation  as  a  "rational 
process"  of  reaching  a  decision  about  the  worth  of  something.  The 
"something"  may  be  the  qual ity  of  a  new  version  of  a  science  program 
or  curriculum,  a  film  strip,  a  new  model  of  the  tape  recorder  to  be 
used  in  schoolrooms,  a  teaching  method,  etc. 

According  to  Harris  (1968,  p.  95),  evaluation  is  "the  systematic 
process  of  judging  the  worth,  desirability,  effectiveness,  or 
adequacy  of  something  according  to  definite  criteria  and  purposes." 
He  gives  six  basic  steps  in  evaluation: 
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1.  Decide  what  to  evaluate. 

2.  Determine  the  purpose  or  role  of  the  thing  which  is 
to  be  evaluated. 

3.  Establish  criteria  traits  and  standards. 

4.  Collect  observation  data. 

5.  Compare  the  observation  data  with  the  criteria 
standards. 

6.  Draw  conclusions  relative  to  the  extent  to  which  the 
observation  traits  measure  up  to  the  criteria  standards. 

Rationale  for  Program  Evaluation 

What  should  the  evaluation  of  teacher  education  programs  encompass? 
The  answers  given  to  the  question  by  experts  in  the  field  vary  widely. 
It  is  possible,  however,  to  list  some  of  the  reasons  on  which  there  is 
wide,  if  not  universal,  agreement,  such  as: 

1.  The  primary  purpose  for  evaluating  teacher  education  programs 
is  to  provide  information  which  can  be  used  in  making  decisions  about 
the  programs. 

2.  Evaluation  should  be  useful  in  helping  people  see  how 
programs  can  be  improved,  rather  than  being  used  extensively  for 
terminal  decisions. 

3.  Evaluation  should  be  used  for  describing  and  judging  the 
nature  and  quality  of  educational  programs. 

4.  Evaluation  efforts  should  be  helpful  in  examining  short-term 
and  long-term  objectives  as  well  as  the  intended  and  unintended 
effects  of  the  program  (Anderson,  Ball,  Murphy,  &  Associates,  1975). 
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Examination  of  Colloborative  Efforts 

The  purposes,  intent,  and  policy  of  the  Teacher  Education 
Center  Act  of  1973  indicate    that  teacher  education  programs  are 
best  carried  out  through  the  collaborative  efforts  of  the  colleges 
and  universities,  the  schools,  and  the  community. 

In  order  to  view  the  collaborative  efforts  as  "a  challenge," 
more  than  "contractual  cooperation,"  Drummond  and  Nuernberger  (1974,  p.  5) 
have  listed  the  requirements  for  collaboration: 

1.  Some  common  goals,  some  mutual  pay-off. 

2.  Equitable  power. 

3.  Commitment  to  cooperation. 

4.  Openness  to  the  influence  of  others,  shown  by  a 
willingness  to  change  one's  outlook,  expectations 
and  ways  of  working. 

5.  Clear  assignment  of  roles  and  responsibilities. 

6.  Agreeable  acceptance  of  assigned  roles  and 
responsibilities. 

7.  Structure  which  provides  the  participants  freedom  to  make 
the  necessary  day-to-day  decisions  to  keep  the  project 
moving,  to  act  independently. 

8.  More  time,  more  money  and/or  the  reallocation  of  the 
resources . 

9.  Continuing  innovation,  stimulating  enterprise  to  keep 
the  venture  from  dying  of  boredom. 
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The  literature  on  collaboration  revealed  that  the  most  important 
requisite  for  successful  collaboration  is  the  ability  of  participat- 
ing members  to  communicate  meaningfully. 

Edelfelt  and  Lawrence  (1975)  advocated  "deliberate  interventions" 
to  promote  collaborative  efforts  in  inservice  education.  They 
suggested  strategies  such  as  consciousness  raising;  identification 
of  institutional  and  personal  interest,  including  the  hidden  as  well 
as  the  obvious  agenda;  dialogue  among  all  parties  about  common 
interests  and  priorities;  consensus  on  the  specific  areas  of 
collaboration  to  be  tried  and  specific  roles  to  be  assigned; 
establishment  of  a  support  system;  and  trial  efforts  with  built-in 
adjustment  procedures. 

Using  the  Stake  terminology,  Reed  (1978)  designed  an  instrument 
to  aid  in  the  examination  of  the  collaborative  process.    She  believed 
that  the  use  of  the  designed  instrument  should  allow  the  teacher 
education  centers  to  address  three  questions: 

1.  What  criteria  must  be  present  in  order  to  have  successful 
collaboration  between  individuals  and  interest  groups? 

2.  Is  there  congruence  between  the  TEC  participants'  intents 
(values)  as  they  relate  to  collaboration,  and  their  perceptions,  as 
they  relate  to  the  center's  collaboration  and  experts'  standards? 

3.  If  there  is  not  congruence,  are  the  participants'  intents 
unrealistic  or  is  the  collaboration,  as  perceived  by  the  participants, 
insufficient?    (pp.  179-180) 
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Reed  hoped  that  the  instrument  would  provide  teacher  education 
centers  with  some  "direction"  for  improving  their  collaborative 
efforts. 

Examination  of  Program  Description 

Fogel  (1973)  assumed  that  the  success  of  a  program  can  be 
determined  by  measuring  the  difference  between  "stated"  goals  and 
"actual  achievement"  of  those  goals.    Stake  (1977)  advocated  an 
innovative  and  suggestive  approach  to  the  problem  of  formal  evalua- 
tion,   fie  offered  a  conceptual  background  for  developing  a  plan 
for  "educational  programs"  rather  than  for  "educational  products," 
and  in  doing  so  he  recommended  "responsive  evaluation." 

According  to  Stake,  an  educational  evaluation  was  "responsive 
evaluation"  if: 

1.  it  orients  more  directly  to  program  activities  than  to 
program  intents ; 

2.  it  responds  to  audience  requirements  for  information; 
and 

3.  the  different  value-perspectives  present  are  referred 
to  in  reporting  the  success  and  failure  of  the  program. 

The  two  "basic  acts"  of  evaluation  according  to  Stake,  were: 

1.  Objective  descriptions  of  goals,  environments,  personnel, 
methods  and  content,  and  outcomes. 

2.  Personal  judgments  as  to  quality  and  appropriateness  of 
those  goals,  environments,  personnel,  methods  and  outcomes. 


n 


Both  the  acts,  "description  and  judgment,"  are 
essential  if  educational  programs  are  to  be  under- 
stood and  improved,    (1977,  pp.  147-180). 

Assignment  of  Responsibility  in  Evaluation 

Finally,  a  question  related  to  the  issue  of  evaluation 
criteria  was:    Who  evaluates?    Scriven  (1967)  suggested  that  staff 
or  team  evaluators  be  heavily  involved  in  the  formative  stage  while 
an  independent  body  of  evaluators  with  no  personal  commitment  to 
the  product  come  in  and  serve  as  the  summative  evaluators.  Baker 
(1974)  remarked  that  the  persons  most  qualified  to  conduct  forma- 
tive evaluation  are  the  development  staff  themselves.  Drummond 
(1978)  commented  that  one  of  the  norms  which  characterized  an 
effective  policy-making  group  was  "the  work  of  the  Policy  Board  is 
assessed  and  evaluated  annually  by  an  outside  evaluator"  (p.  183). 

Anderson,  Ball,  Murphy,  and  Associates  (1975,  pp.  147-151) 
suggested  the  use  of  different  opposing  strategies  by  the  evaluators 
for  acquiring  useful  data  and  judgments  in  the  process  of  evaluation. 
The  suggested  strategies  were: 

1.  Formative  vs.  summati ve--focusing  on  feedback  for  program 
improvement  versus  evaluation  of  the  overall  outcomes  of 
the  program. 

2.  Comparative  vs.  absolutist--judging  results  in  comparison 
with  performance  of  another  group  versus  judging  results  in 
terms  of  some  fixed  standards  related  to  program  objectives. 
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3.  Internal  vs.  external --conducted  by  members  of  the  program 
staff  versus  outside  evaluators. 

4.  Experimental  vs.  quasi-experimental--the  "true"  controlled 
experiment  versus  designs  with  inevitable  equivocality 
caused  by  the  absence  of  randomization. 

5.  Extended  vs.  constrai ned--where  the  evaluator  feels  free 
to  go  beyond  the  immediate  time  span  and  the  assumptions 
of  the  particular  program  to  be  evaluated  versus  the 
evaluator  restricted  to  establishing  conditions,  assump- 
tions, and  "real"  program  time. 

In  addition  to  the  use  of  different  opposing  strategies,  Anderson, 
Ball,  Murphy,  and  Associates  have  listed  a  number  of  roles  that 
evaluators  may  play,  depending  on  the  situations  and  personalities 
of  the  participants  in  the  process  of  evaluation.    The  different 
roles  described  are:    Evaluator  as  judge,  juror,  defendant,  attorney, 
expert  witness,  detective,  social  worker,  and  court  reporter. 

While  commenting  upon  different  roles,  Anderson  and  others 

advocated  the  role  of  expert  witness  as  a  "proper"  one  for  an  evaluator. 

Further  they  contended: 

To  hide  one's  results  and  conclusions  for  fear  of  attack 
is  regrettable;  to  hide  them  and  then  criticize  the  final 
decisions  is  deplorable;  but  to  present  them  voluntarily, 
honestly,  and  openly--that  seems  to  us  the  mark  of  a 
professional.    (1975,  p.  150) 
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The  Teacher  Education  Center  Development 


It  has  been  generally  estimated  that  it  takes  over  20  years  for 
a  new  innovation  to  work  its  way  into  the  mainstream  of  American 
education.    However,  Schmieder  and  Yarger  (1 observed  that  the 
teacher  education  center  movement  had  taken  less  than  a  half  decade 
to  become  a  well  known  locus  for  new  approaches  to  educational  per- 
sonnel development.    According  to  them,  the  educational  personnel 
development  was  the  key  factor  for  the  existence  and  growth  of  teacher 
centers  throughout  the  nation. 


The  National  Scene 

In  Public  Law  94-482  of  the  Higher  Education  Amendments  of 

1976,  Part  B,  Teacher  Centers  were  defined  as: 

A  site  operated  by  a  local  educational  agency  (or  a 
combination  of  such  agencies)  which  serves  teachers, 
from  public  and  non-public  schools  of  a  state,  or  an 
area  or  community  within  a  state,  in  which  teachers 
with  assistance  of  such  consultants  and  experts  as  may 
be  necessary,  may-- 

(a)  develop  and  produce  curricula  design  to  meet  the 
educational  needs  of  the  persons  in  the  community, 
area,  or  state  being  served,  including  the  use  of 
educational  research  findings  or  new  or  improved 
methods,  practices,  and  techniques  in  the  develop- 
ment of  such  curricula;  and 

(b)  provide  training  to  improve  the  skills  of  teachers 
to  enable  such  teachers  to  better  meet  the  special 
educational  needs  of  persons  such  teacliers  serve, 
and  to  familiarize  such  teachers  with  developments 
in  curriculum  development  and  educational  research, 
including  the  manner  in  which  the  research  can  be 
used  to  improve  their  teaching  skills.    (1976,  pp. 
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According  to  Schmieder  the  new  Teacher  Center  Law  turned  things 
"inside  out."    He  further  predicted,  "Teachers  will  finally  be  given 
the  major  responsibility  for  determining  the  kinds  of  changes  and 
improvements  that  are  needed  in  their  classrooms  and  will  also  have 
the  lead  in  putting  together  the  kinds  of  training  and  curriculum 
development  programs  that  will  best  meet  those  needs"  (Schmieder, 
1978,  p.  1). 

The  basic  purpose  of  teacher  centers,  according  to  Schmieder, 
seemed  to  enable  teachers  to  have  a  greater  voice  in  determining  and 
meeting  their  own  needs  for  inservice  training  and  curriculum  develop- 
ment in  relation  to  the  needs  of  the  students  whom  they  serve.  The 
teacher  center  might  serve  a  single  school  district,  a  larger  region, 
or  an  entire  state.    The  chief  feature  of  the  centers  was  that  each 
was  to  be  supervised  by  a  "teacher  center  policy  board"  (p.  1). 

The  federal  Teacher  Center  Law  had  provisions  for  state  depart- 
ments of  education  to  have  an  important  three-part  role:  screening 
applications,  providing  technical  assistance,  and  assuring  proper 
dissemination  of  the  program's  finding  and  products.    For  this 
purpose,  10  percent  of  funds  were  to  be  granted  to  institutions  of 
higher  education  to  operate  centers;  the  balance  assigned  to  local 
educational  agencies. 

Feiman  observed  that  since  the  late  sixties,  the  concept  of 
teacher  centers  had  become  increasingly  attractive  to  American 
educators  concerned  about  improving  teacher  education  and  schooling. 
She  further  traced  the  development  of  teacher  centers  and  stated: 
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The  idea  received  a  major  formulation  by  an  NDEA  Task 
Force  for  the  Study  of  Teaching  the  disadvantaged. 
Federal  planning  grants  materialized  under  the  Educa- 
tion Professions  Development  Act,  and  schools  of 
education  and  state  departments  organized  coalitions 
to  plan  center  programs.    News  of  British  teachers' 
centers  reached  this  country  ...  the  NBA  and  AFT 
endorsed  the  idea  of  the  teacher  center  concept, 
urging  their  affiliates  to  seek  district  funding  and 
to  insist  on  teachers'  control  of  programs,  while 
the  American  Association  of  Colleges  for  Teacher 
Education  advocated  a  strong  support  and  leadership 
role  for  colleges  and  universities.    (1977,  p.  395) 

This  latest  development  simply  reinforced  the  conclusion  of  Allen 

Schmieder  and  Sam  Yarget  that  "the  teacher  or  teaching  center  is 

one  of  the  hottest  educational  concepts  on  the  scene  today"  {1974a, 

p.  5). 

Two  major  educational  emphases  (DeVault  et  al . ,  1978) 
contributed  to  the  initial  impetus  for  teacher  centers  in  this 
country.    Technology  was  one  of  these  emphases  and  the  self-initiat- 
ing spontaniety  of  humanism  was  the  other.    The  first  has  resulted 
in  the  large,  bureaucratic,  substantially  funded  centers  that  fre- 
quently included  competency-based  education  emphases;  the  other  was 
the  teacher-oriented  center,  with  major  support  from  the  trend  toward 
open  education. 

Estimates  concerning  the  scope  of  teacher  center  activity  varied 
according  to  one's  definition.    As  Schmieder  and  Yarger  point  out, 
the  term  "might  just  as  well  refer  to  three  teachers  opening  a  store- 
front shop  in  Harlem  as  to  a  state  controlled  network  designed  to 
serve  literally  thousands  of  teachers  and  other  education  personnel" 
(1974b,  p.  28). 
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One  study  determined  that  18  out  of  50  states  had  either 
legislative  or  administrative  provisions  for  establishing  or 
supporting  teacher  centers  (Smith,  1974).    A  national  survey  of 
school  systems  and  teacher  training  institutions  conducted  by  the 
Syracuse  Teacher  Center  Project  identified  600  "eligible"  institu- 
tions (Yarger  &  Leonard,  1974).    The  Teachers'  Center  Exchange, 
supported  by  the  National  Institute  of  Education,  maintained  a 
communication  network  among  a  core  group  of  about  100  teachers' 
centers  (DeVaney  &  Thorn,  1975). 

Feiman  believed  that  basic  differences  among  teacher  centers 
stemmed  not  so  much  from  the  organizational  forms  they  took  as  from 
the  assumptions  on  which  those  forms  were  built.    In  other  words, 
associated  with  different  kinds  of  centers  were  certain  beliefs  about 
what  teachers  were  like,  who  should  control  their  education  and 
training,  how  they  could  reflect  different  views  of  teaching  and 
learning  (1977,  p.  396). 

Further,  Feiman  examined  teacher  center  activity  in  terms  of 
current  educational  ideologies  and  labelled  teacher  education  centers 
as  "behavioral,"  "humanistic,"  and  "developmental,"  because  they 
offered  a  set  of  interpretive  frameworks,  for  classifying  differences 
in  center  beliefs,  programmatic  features,  and  approaches  to  evaluation. 

Differentiating  behavioral,  humanistic,  and  developmental 

centers,  according  to  Feiman,  served  three  main  purposes: 

First,  it  helps  clarify  the  different  ways  that  teacher 
centers  have  viewed  their  functions  and  designed  their 
programs.    Second,  it  highlights  some  of  the  concerns 
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which  flow  from  each  perspective  and  have  implications 
for  program  planning  and  evaluation.    Third,  the  dis- 
tinctions offer  center  perspectives  for  examining  the 
arguments  in  support  of  any  one  approach.    (1977,  p,  408) 

Finally,  from  the  review  of  literature  on  the  teacher  education 

center  development  in  the  U.S.A.,  it  seemed  that  the  prediction  made 

by  Leonard  Kaplan,  "The  Teacher  Center  movement  is  here  to  stay" 

(1978,  p.  149),  would  hold  true. 

The  Florida  Scene 

The  Teacher  Education  Centers  (TEC)  were  a  matter  of  law  in 
Florida.    The  Florida  Legislature  passed  the  Teacher  Education 
Center  Act  in  1973,  authorizing  the  establishment  of  TECs  in  Florida. 
As  of  September,  1978,  there  were  27  centers  serving  45  out  of  67 
school  districts,  and  the  law  mandated  state-wide  implementation  of 
TECs  prior  to  June  30,  1979. 

As  of  the  time  of  this  study,  Florida  was  the  only  state  in  the 
country  which  had  enacted  direct  legislation  to  create  a  system  of 
teacher  education  centers.    Smith  (1974,  p.  22)  categorized  the  50 
states  according  to  whether  or  not  they  had  enacted  legislation 
regarding  teacher  centers  and  according  to  the  extent  of  state-level 
study  and/or  regulations  relating  to  centering.    Seventeen  states 
had  no  legislation  but  did  make  administrative  provisions  regarding 
centers.    Finally,  four  states  had  enacted  legislation;  only  one, 
Florida,  established  a  system  under  the  law. 

The  teacher  education  centers  in  Florida  brought  a  new  emphasis 
on  collaboration,  shared  decision-making  and  field  experience. 
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These  were  important  elements  in  both  preservice  and  inservice 

teacher  education.    In  Florida,  these  elements  were  found  in 

varying  degrees.    The  Teacher  Education  Center  Act  of  1973 

represented  the  State's  official  position  on  the  teacher  education 

center  movement: 

The  most  important  influence  the  school  can  con- 
tribute to  the  learning  of  any  student  is  the 
attitudes,  skills,  knowledge,  and  understanding 
of  the  teacher.    If  any  change  is  desired  in  the 
nature  or  quality  of  the  education  programs  of  the 
schools,  it  will  come  about  only  if  teachers  play 
a  major  role  in  the  change.    Teachers  can  best 
assist  with  improving  education  when  they  directly 
and  personally  participate  in  identifying  needed 
changes  and  in  designing,  developing,  implementing 
and  evaluating  solutions  to  meet  the  identified 
needs.    (Sec.  231.601(2),  F.S.) 

The  impetus  for  the  establishment  of  Florida  centers  were 
traced  to  a  number  of  factors.    The  most  direct  historical  link  to 
the  rest  of  the  nation  would  seem  to  be  through  the  Multi-State 
Teacher  Education  Project  (M-STEP)  which  received  initial  funding  in 
1965  (Behling,  1970,  p.  5).    Florida  was  one  of  six  states  in  this 
project.    The  main  purpose  of  the  centers  which  cane  about  through 
M-STEP  was,  according  to  Behling  (1975,  p.  7),  "to  achieve  a  joint 
sovereignty  for  teacher  education  shared  by  the  colleges,  state 
departments,  schools  and  associations."    This  same  content  ultimately 
became  included  in  the  Florida  legislation. 

In  addition  to  M-STEP,  an  invitational  conference  held  on  the 
University  of  Florida  campus  prompted  the  growth  of  the  teacher 
center  movement  in  Florida.    The  conference  was  planned  to  focus  on 


19 


the  special  problems  and  opportunities  created  by  broadening  the 

base  of  participation  in  the  governance  of  teacher  educators. 

The  Florida  educators  (Drummond  &  Nuernberger,  1974)  termed  the 

Florida  Collaboration  Model  Project  as  "A  Very  Strange  Bird." 

They  further  explained: 

The  creators  of  the  Florida  Model  have  no  idea  how 
their  "bird"  will  look  or  fly,  they  have  simply  a  few 
more  ideas  about  what  nurtures  it,  and  in  what  climates 
it  will  flourish.    Although  in  its  youth  it  seems  to 
be  as  slow  and  helpless  as  a  dodo  in  the  face  of 
predators,  it  is  probably  a  hearty  bird,  and  a  color- 
ful one!    (1974,  p.  13) 

The  report  of  the  State  Council  stated  an  important  character- 
istic of  Florida  teacher  education  centers  (SCFTEC,  1975,  p.  2): 
It  is  a  concept  and  not  a  place.    The  concept  of  Florida  centers 
"is  based  on  the  assumption  that  .  .  .  teacher  training  can  signifi- 
cantly improve  .  .  .  through  collaborative  effort." 

Van  Fleet  (Note  3)  wrote  of  the  Florida  movement  as  a  model  of 
an  "idealized  process."    He  observed  that  there  were  two  essential 
themes  with  the  model.    The  first  was  institutional  reform  in 
teacher  education.    The  second  was  a  move  toward  broader  participa- 
tion in  professional  training. 

Finally,  as  of  the  time  of  this  study,  there  was  a  move  and  a 
plan  submitted  to  the  University  of  Florida  President  Marston  for 
establishing  an  Institute  for  Teacher  Education  Centers  at  the 
University  of  Florida  campus  (Drummond,  Note  2).    One  of  the 
assumptions  stated  in  the  plan  was: 
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Because  TECs  should  be  "dynamic  organizations",  the 
skills  and  attitudes  necessary  for  organizational  and 
situational  learning  should  be  fostered  .  .  .  where 
people  who  are  involved  can  share  experiences  and 
reinforce  one  another's  efforts.    (1978b,  p.  2). 

Thus  the  advocates  of  the  Florida  TEC  movement  sought  to 

make  the  Florida  bird  dynamic,  as  well  as  hearty  and  colorful. 

The  Evaluative  Efforts  in  Teacher  Education  Centers 

A  critical  reading  of  the  literature  on  the  evaluative  efforts 
in  teacher  education  centers  disclosed  that  until  now,  most  efforts 
have  been  focused  on  structural  features,  for  example,  how  and  by 
whom  they  are  organized  and  governed.    Feiman  (1977)  stated,  "there 
has  not  been  a  comprehensive  effort  to  link  different  structures 
with  different  functions  or  to  connect  various  programs  and  purposes 
with  their  associated  premises  and  outcomes"  (p.  395). 

The  National  Scene 

A  study  was  undertaken  by  Evans  (1974)  to  investigate  differences 
in  classroom  teaching  behavior  between  secondary  student  teachers 
placed  in  a  teacher  education  center  and  student  teachers  in  tiie 
traditional  student  teaching  setting.    The  results  indicated  no  sig- 
nificant differences  in  classroom  teaching  behavior  between  the  tv;o 
groups,  although  student  teachers  in  the  teacher  education  center  had 
more  positive  attitudes  toward  teaching  and  supervision. 
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In  another  study.  Information  Board  Evaluation  (IBE)  was  used 
to  evaluate  a  Comprehensive  Diagnostic  Teaching  Center  (DTC)  which, 
in  addition  to  providing  teacher  training  and  services  to  handi- 
capped pupils,  would  bring  together  and  focus  all  of  the  resources 
of  the  Indianapolis  Public  Schools  on  this  program  (Poteet,  1974). 
Reasons  were  stated  indicating    the  inadequacy  of  traditional 
performance  objective  evaluation.    However,  IBE  was  not  free  of 
the  use  of  objectives;  their  use  was  justi fied  when  feedback  v/as 
important  to  information  users.    When  looking  at  the  evaluation 
process  for  any  program,  it  was  recommended  that  one  concept  of 
evaluation  be  adopted  and  maintained  through  the  life  of  the  project 
insofar  as  possible. 

"Teacher  Education  Center  Self-Study"  was  undertaken  by  the 
participating  school  system  and  the  University  of  Maryland  (1975). 
The  purpose  was  to  examine  the  14  teacher  education  centers  which 
have  been  in  operation  since  the  mid-1960s.    The  questions  investi- 
gated were: 

(a)  In  what  preparatory  experiences  are  student  teachers 
engaged? 

(b)  Do  experienced  teachers  provide  and  review  experiences 
for  student  teachers  based  on  competencies  acquired  in 
inservice  education? 

(c)  What  is  the  variation  observed  in  available  inservice 
content  and  sources  of  information  among  experienced 
teachers? 

In  this  study  some  differences  between  centers  were  found, 
raising  the  question  of  what  effects  the  differences  have 
on  the  career  of  a  professional. 

Robert  Covert  and  others  (1973-74)  reported  Evaluation  of  the 
Four  Teacher  Center  Pilots  in  the  National  Teacher  Center  programs: 
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the  Bay  Area  Learning  Center  in  Northern  California,  the  Rhode 
Island  Teacher  Center  in  Providence,  the  Texas  Center  for  the 
Improvement  of  Educational  Systems  in  Austin,  and  the  Center  for 
Educational  Advancement  located  in  Washington,  D.C.    The  report 
dealt  with  evaluation  methodology  and  noted  the  six  categories 
selected  to  aid  in  this  evaluation: 

(1)  establishment  of  program  goals 

(2)  establishment  of  information  systems 

(3)  delivery  of  products,  processes,  and  services 

(4)  creation  of  new  programs 

(5)  increase  of  interinstitutional  governance,  and 

(6)  importance  of  organizational  health. 

The  report  also  described  similarities  and  differences  across 
projects  and  discussed  conclusions  arrived  at  after  the  examination 
of  data  pertinent  to  the  future  development  of  teacher  centers. 

Another  study  was  reported  by  Steinmez  and  others,  who  examined 
the  nature  and  extent  of  collaboration  of  Texas's  centers  (1974-1975). 
The  report  included  a  set  of  topics  on  collaborative  activities  at 
each  local  TEC  in  relation  to  the  following: 


(a 
(b 
(c 
(d 
(e 
(f 

(g 

(h 
(1 
(j 
(k 

(1 
(m 

(n 

(0 


goals 

bylaws  and  organizational  structure 
meeting:    number,  attendance,  and  purpose 
executive  resources  and  roles 
funds 

physical  facilities 

selection  tenure,  orientation,  and  resources  of 
members 

roles  of  partners 

activities 

leadership 

linkages 

effects 

summary  and  implications  based  on  local  TEC  site 
interviews 

additional  insights  based  on  interviews  with  Executive 
Committee  members  of  the  project,  and 
general  remarks. 
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Feiman  (1977)  commented,  "Too  often  evaluation  is  used  to 
provide  a  data  base  for  defending  or  attacking  a  particular 
program  at  refunding  time"  (p.  408). 

Finally,  the  review  of  literature  indicated  that  there  was 
insufficient  knowledge  about  what  was  going  on  in  different  kinds 
of  centers,  why  these  particular  activities  were  taking  place,  how 
they  related  to  the  needs  and  interests  of  center  clients,  and  what 
short  and  long-range  effects  were  provided. 


The  Florida  Scene 

The  evaluation  of  TEC  was  established  as  a  "joint  responsi- 
bility" of  each  Teacher  Education  Center  and  the  State  Council  for 
TECs  by  the  Teacher  Education  Center  Act  of  1973.    The  Section 
231.608  (Florida  Statutes)  required: 

(1)  Each  teacher  education  center  shall  submit  an 
annual  report  to  the  State  Council  for  Teacher 
Education  Centers.    This  report  shall  be  based 
on  the  measurable  objectives  of  the  center  pro- 
posal and  shall  include,  but  not  be  limited  to, 
the  following: 

(a)  A  description  and  evaluation  of  programs 
conducted  under  the  supervision  of  the 
center. 

(b)  The  number  of  participants  in  center  program 
activities. 

(c)  A  description  and  evaluation  of  methods  of 
center  operations. 

(d)  A  statement  of  center  expenditures. 

(2)  The  State  Council  shall  review  the  annual  reports 
and  submit  its  evaluation  to  the  State  Board  of 
Education,  President  of  the  Senate,  Speaker  of  the 
House  of  Representatives,  and  Chairmen  of  the 
Senate  and  House  committees  on  education. 
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The  first  attempt  to  study  the  problems  of  teacher  education 

centers  in  Florida  was  made  by  Van  Fleet  (1977).    After  the 

critical  examination  of  then-existing  problems  of  centers,  he 

concluded  that    interrelated  internal  and  external  factors  affected 

the  problems  of  center  implementation.    Internal  factors,  according 

to  him,  included  the  following: 

--the  distribution  of  authority  within  the  center, 

--an  imbalance  in  the  financial  base  for  center  operation, 

--the  effects  of  traditional  role  expectations  and  job 
descriptions  of  center  participants, 

--the  relative  attractiveness  of  centers,  based  on  the 
financial  incentives  for  starting  a  center,  and 

--the  lack  of  needed  technology  and  social  relations  for 
a  sound  assessment  of  teacher  training  needs. 

External  factors  included  the  following: 

—  the  interests  of  state-level  educational  organizations, 

—  the  advent  of  professional  teacher  organizations  in  the 
state, 

—a  depressed  state  economy  that  affected  school  revenues, 
and 

--a  changing  demography  and  teacher  supply,    (p.  123) 
In  another  study,  Barrett  (1976)  examined  the  effectiveness  of 
the  Teacher  Education  Center  Professional  Power  Pact  (TEC-TP-^)  for 
improving  the  operation  of  specific  teacher  education  center  councils 
in  Florida.    He  concluded  that  through  the  use  of  Power  Pact  (TEC-TP-^), 
"members  of  the  council  broadened  their  understanding  of  data  gather- 
ing, evaluation,  and  Florida  law  and  administrative  regulations" 
(p.  158). 


25 


In  May,  1977,  the  Florida  Department  of  Education,  in 
cooperation  with  other  state  agency,  district,  university,  and 
legislative  staff,  reviewed  and  analyzed  Florida  Teacher  Educa- 
tion Centers.    In  its  report,  the  DOE  made  a  recommendation 
related  to  the  evaluation  of  teacher  education  centers.  The 
report  recommended: 

The  greater  attention  should  be  given  to  evaluating 
programs  carried  out  in  teacher  education  centers  and 
monitoring  the  collaborative  process  used  in  the 
teacher  education  center  approach.    Therefore,  .  .  . 
the  procedures  should  be  developed  cooperatively  with 
input  from  the  task  force  or  other  working  group 
designated  by  the  Commissioner  of  Education  from  the 
State  Education  Agency  staff,  the  State  Council  for 
Teacher  Education  Centers,  the  State  Council  on 
Teacher  Education,  and  teacher  education  center 
directors'  group,  and  other  groups  with  related 
responsibility,    (pp.  56-57) 

The  above  stated  recommendation  clearly  identified  the 
groups  which  were  responsible  for  the  evaluation  activities  in  TECs 
in  Florida.    This  recommendation  also  reinforced  the  need  for  this 
study:    criteria  for  evaluation  of  teacher  education  center  programs 
in  Florida. 


Implications  from  the  Review 

As  of  1979,  teacher  education  centers  operated  in  a  v/eb  of 
social,  political,  and  professional  influences.    There  was  a  need 
to  take  into  account  all  the  factors  affecting  the  operation  of 
teacher  education  centers.    It  was  appropriate  to  concentrate  on 
evaluative  criteria  which  could  contribute  to  program  development 
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and  provide  more  detailed  information  about  teacher  education 
center  operation. 

The  purpose  of  this  study  was  to  develop  and  propose  criteria 
based  on  the  knowledge  of  Stake,  Cahen,  and  Feiman,  and  to  devise 
an  evaluation  process  which  would  provide  relevant  data  to  all 
the  responsible  groups  connected  with  teacher  education  center 
programs . 


CHAPTER  III 
THE  PROCESS  FOR  DEVELOPING  CRITERIA 


The  process  used  for  developing  criteria  was  mainly  a  group 
process  which  provided  an  opportunity  for  the  educational  community 
to  reexamine  the  purposes  and  potential  of  TECs  in  Florida.  The 
group  process  also  opened  and  stimulated  communication  among  and 
between  the  groups  having  a  stake  in  the  TEC  programs  and  activities. 

The  Design  of  the  Study 

This  study  actually  originated  through  a  discussion  held  between 
the  investigator  and  Dr.  William  Drumond  (University  of  Florida) 
regarding  the  process  of  evaluation  utilized  in  evaluating  TECs  in 
Florida.    As  a  result  of  the  discussion,  an  urgent  need  for  develop- 
ing criteria  was  felt,  with  an  emphasis  on  qualitative  rather  than 
quantitative  evaluation.    Following  the  discussion,  a  proposal 
(Appendix  A-2)  was  presented  at  the  meeting  of  the  State  Council  for 
TECs  held  on  June  12,  1973.    The  proposal  received  favorable  responses 
from  all  the  members  of  the  State  TEC  Council,  since  the  need  for 
developing  a  process  for  evaluation  was  one  of  the  agenda  items  of 
the  council  meeting.    The  Council  officially  adopted  the  proposal 
and  resolved  as  follows: 
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"that  the  Council  endorse  the  efforts  of  both  Cyndee 
Hutchinson  and  Zohra  Setranjiwalla,  do  what  is  possible 
to  assist  them,  if  no  more  than  to  provide  a  letter  of 
endorsement  which  might  be  used  by  them  as  they  work 
with  local  teacher  education  centers."    The  Motion  was 
passed  unanimously.    (The  minutes  of  the  Florida  State 
TEC  Council,  June,  1973;  Note  4) 

Following  the  meeting,  the  study  was  designed  in  three  main 
stages:    (1)  the  conceptual  evaluation  plan,  (2)  the  status  report 
based  on  documents,  and  (3)  the  team  visitation  to  TEC  sites. 

The  Conceptual  Evaluation  Plan 

An  extensive  literature  review  (Chapter  II)  pertinent  to  the 
problems  of  program  evaluation,  the  teacher  education  center  develop- 
ment, and  the  evaluation  efforts  in  teacher  education  centers  was 
carried  out  and  a  Conceptual  Evaluation  Plan  (Appendix  B-1 )  was 
developed  to  carry  out  the  study.    This  conceptual  evaluation  plan 
was  discussed  with  Mr.  James  Parris  (Department  of  Education)  and 
Dr.  Drummond  in  order  to  determine  the  feasibility  and  the  relation- 
ship of  the  plan  to  the  actual  needs  of  practitioners  in  the  field; 
both  approved  the  plan  and  offered  suggestions. 

The  conceptual  plan  identified  five  major  areas  of  investigation; 
(1)  the  rationale  for  the  evaluation  of  TECs,  (2)  the  data  for 
evaluation,  (3)  the  role  of  the  evaluator,  (4)  the  design  of  evalua- 
tion, and  (5)  the  resources  and  facilities  available  for  evaluation. 

Following  the  conceptual  evaluation  plan,  four  concept  papers 
(Appendix  B-2,  B-3,  B-4,  B-5)  were  prepared  incorporating  the  con- 
ceptual views  advocated  by  experts  and  scholars  in  the  literature. 
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These  concept  papers  described:    (a)  rationale  for  program  evalua- 
tion, (b)  extent  of  collaboration  and  participation,  (c)  program 
description,  and  (d)  assignment  of  responsibility  in  evaluation. 

The  Status  Report  Based  on  Documents 

A  document  search  was  carried  out  for  three  weeks  at  the 
office  of  the  Department  of  Education,  Tallahassee,  to  accomplish 
two  purposes: 

1.  To  ascertain  the  status  of  TEC  evaluation. 

2.  To  determine  the  methods  or  criteria,  if  any,  being 
utilized  in  evaluation  by  the  existing  local  TECs 
and  State  TEC  Counci 1 . 

The  document  search  was  confined  to  the  examination  of  three 
major  categories  of  TEC  documents:  (1)  the  annual  reports  of  the 
local  TECs,  (2)  the  evaluation  reports  of  the  local  TECs,  and  (3) 
the  minutes  of  the  State  TEC  Council. 

The  procedure  involved  in  this  study  was  descriptive  as  well 
as  evaluative.    The  evaluation  study  was  to  be  partly  an  explora- 
tion of  values,  partly  a  declaration  of  values  as  seen  by  the 
"actors,"  the  "spectators,"  and  critics  themselves  (Stake,  1967b). 
During  the  process  of  document  search,  a  layout  of  statements  and 
data  were  collected  using  the  following  Data  Matrices,  adapted  from 
Robert  Stake's  "responsive  evaluation:" 
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Data  Matrices 


Intents     Observations        Standards  Judgments 


Rationale 


Antecedents 


Transactions 


Description  Matrix 


Outcomes 


Judgment  Matrix 


Evaluation  at  the  Local  TEC  Level 
Objective  Description 

1.  All  the  TECs  are  required  to 
submit  an  annual  evaluation 
report,  yet  some  TECs  submit 
it  at  the  end  of  the  third 
year, 

2.  The  evaluation  report  is  sub- 
mitted on  a  regular,  estab- 
lished schedule  designed  by 
the  DOE. 


Investigator's  Personal  Judgment 

The  annual  submission  of  the 
evaluation  report,  if  required 
from  all,  would  help  in  deter- 
mining the  status  of  TEC 
programs. 

The  schedule  lays  emphasis  on 
quantitative  information  about 
TEC  programs. 
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3.  All  the  centers  have  re- 
ported data  sources  such 
as  minutes  of  meetings, 
surveys,  etc.  in  the 
column  of  "Evaluation 
Procedure"  stated  in 
their  proposals . 

4.  All  the  TECs  have  submitted 
a  "needs  assessment  plan" 
in  their  evaluation  pro- 
cedures . 


5.  The  evaluation  records  sub- 
mitted by  some  of  the  TECs 
consist  of  Program  Schedules, 
a  copy  of  the  Master  Plan, 
etc. 

6.  Most  of  the  TECs  have  sub- 
mitted their  evaluation 
results  on  a  regular 
schedule  in  one  or  two 
statements . 

7.  The  time  span  for  the  evalua- 
tion of  TEC  programs  varies 
from  one  to  three  years. 

8.  Some  TECs  have  submitted  a 
separate  proposal  for  the 
purpose  of  evaluation, 
seeking  separate  resources 
for  the  purpose. 

9.  The  number  of  programs  and 
center  staff  vary  from  1  to 
175  and  from  1  to  25  respec- 
tively in  a  year. 


The  term,  evaluation  procedures, 
has  been  equated  with  the 
system  of  filing  and  documenta- 
tion. 


There  seems  to  be  a  heavy 
emphasis  on  the  evaluation  of 
needs  assessment,  because  it 
is  a  major  activity  in  almost 
all  TECs. 

The  evaluation  records  submitted 
by  some  of  the  TECs  include 
irrelevant  material  and  do  not 
contain  any  evaluative  statements. 


The  evaluation  resul ts  submitted 
by  the  TECs  do  not  indicate  any 
purpose,  data,  or  criteria  used 
in  the  evaluation  process. 


There  is  no  systematic,  regular 
or  periodical  plan  of  evaluation. 


Most  of  the  TECs  have  totally 
ignored  resources  for  the 
evaluation  of  TEC  programs. 


There  needs  to  be  some  criteria 
for  effective  management  of 
programs  and  for  center  staff 
in  terms  of  numbers . 
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Evaluation  at  the  State  TEC  Council  Level 

1.  The  State  TEC  Council  had  kept  a  record  of  the  annual  evaluation 
reports  submitted  by  the  local  TECs  in  Florida. 

2.  The  TECs  annual  reports  (1977-78)  had  been  summarized  and 
quantitative  data  had  been  tabulated  in  relation  to  center 
operation,  objectives,  participation,  revenue  and  expenditures 
(Appendix  C-1 ) . 

3.  The  State  TEC  Council  had  dealt  with  the  issue  of  TEC  evaluation 
twice  in  two  years  (November,  1978  and  June  12,  1978;  Note  4,  Note  5). 

4.  In  the  minutes  of  the  State  TEC  Council's  meeting,  held  in 

November,  1978,  the  role  of  the  State  TEC  Council  in  relation 

to  TEC  evaluation  had  been  described  as  follows: 

...  It  is  felt  that  the  Council  should  be  funded  for 
any  evaluation  it  makes,  and  Dr.  Wilk  asked  that  the 
Task  Force  take  another  look  at  dual  funding. 

...  It  is  agreed  that  TECs  must  be  evaluated  because 
they  are  mandated.    It  was  also  agreed,  however,  that  it 
should  not  be  the  State  Council's  personal  responsibility 
to  personally  evaluate  each  TEC.    Council  members  felt 
TEC  needs  would  be  best  served  by  altering  the  Master 
Inservice  Plan  (MIP)  evaluation  format  to  accomodate  TEC 
evaluation  and  by  having  a  State  Council  member  as  a 
part  of  MIP  evaluation  teams. 

5.  The  State  TEC  Council  members  exhibited  interest  in  the  plans 
presented  by  Cyndee  Hutchinson  and  Zohra  Setranj iwal la  at  the 
meeting  held  on  June  12,  1978.    The  Council  felt  that  both  the 
studies  would  lend  support  to  the  Council's  efforts  to  determine 
evaluation  procedures  (supra,  p.  28). 
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Thus  an  exmaination  and  review  of  the  TEC  documents  in 
relation  to  the  evaluation  of  TEC  revealed  the  following: 

1.  There  had  been  no  standards  or  criteria,  to  date, 
to  evaluate  the  existing  teacher  education  centers. 

2.  The  reports  submitted  by  the  local  TECs  emphasized 
quantitative  rather  than  qualitative  assessments. 

3.  The  need  for  developing  qualitative  measures  had  been 
expressed  as  a  priority  issue. 

Team  Visitation  to  TEC  Sites 

The  third  stage  in  the  design  of  the  study  began  with  a  plan 
for  team  visits  (Appendix  C-1  to  C-5).    The  three  centers  selected 
at  random  for  team  visitation  were  Alachua  County  TEC,  Northeast 
TEC,  and  Polk  County  TEC.    The  purpose  of  the  team  visitation  was  to 
try  out  the  proposed  criteria,  initially  developed  by  the  investigator 
on  the  basis  of  data  gathered  through  the  document  search  and  litera- 
ture review  on  TEC  program  evaluation.    The  team  visitation  provided  an 
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opportunity  for  nine  different  role-groups:    (1)  teachers,  (2) 
principals,  (3)  administrators,  (4)  TEC  directors,  (5)  citizens, 
(6)  college  professors,  (7)  school  board  members,  (8)  DOE  repre- 
sentatives, and  (9)  teacher  organization  representatives;  to 
directly  participate  in  the  development  of  criteria  and  exchange 
their  views  on  the  process  of  TEC  evaluation.    Table  1  given  below 
indicates  that  a  total  of  65  TEC  members,  representing  the  nine 
different  role  groups,  participated  in  the  process  for  developing 
the  criteria  for  TEC  evaluation. 


Table  1 

TEC  Site  Visitation  Participants 


Participants 

Alachua 

Northeast 

Polk 

State  TEC 
Council 

Total 

Teacher 

7 

7 

8 

6 

28 

Principal 

2 

0 

1 

1 

4 

Administrator 

1 

3 

2 

0 

6 

Director 

2 

2 

2 

0 

6 

Citizen 

1 

0 

1 

0 

2 

Professor 

3 

2 

3 

2 

10 

School  Board  Member 

0 

0 

0 

1 

1 

DOE  Representative 

1 

1 

1 

1 

4 

Teacher  Organization 
Representative 

1 

1 

1 

0 

3 

Session  Leader 
(Same  Person) 

1 

(1) 

(1) 

(1) 

1 

Total 

19 

16 

19 

11 

65 

i 


35 


Table  2  given  below  indicates  the  schedule  of  TEC  visitations. 
There  were  a  total  of  four  visits,  organized  at  an  interval  of  six 
to  seven  days,  approximately.    Originally,  three  visits  to  the  TEC 
sites  were  planned;  later  on,  another  visit  to  the  State  TEC  Council 
was  organized  after  consultation  with  fir.  Parris  and  Dr.  Drummond. 
Unfortunately,  the  time  (Appendix  C-5)  allotted  by  the  State  TEC 
Council  for  team  evaluation  was  inadequate,  and  the  regular 
schedule  had  to  be  modified  in  terms  of  time  and  the  processes 
designed  for  developing  the  criteria. 

Table  2 
Schedule  of  TEC  Visitation 


Visiting 

Team  Place  Date  Time 


Team  #1     Alachua  County  TEC  January  11,  1979     10:00  am  -  3:00  pm 

Gainesville,  FL 

Team  #2     Northeast  TEC  Consortium     January  17,  1979     10:00  am  -  3:00  pm 
Palatka,  FL 

Team  #3     Polk  County  TEC  January  25,  1979     10:00  am  -  3:00  pm 

Bartow,  FL 

Team  #4     State  TEC  Council  February  8,  1979     10:30  am  -11:50  am 

Tallahassee,  FL 
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Administration  of  Criteria 

The  process  of  development  of  criteria  began  with  the  presenta- 
tion of  the  session  plan  (Appendix  D-1)  to  the  team  members  visiting 
the  TEC  sites.    Four  sessions  were  conducted  to  work  on  the  following 
four  sections:    A,  B,  C,  and  D,  respectively. 


Initially  Proposed  Set  of  Criteria 

Section  A      RATIONALE  FOR  THE  EVALUATION 

1.  Statement  of  Policy 

2.  Regularity  in  Evaluation 

Section  B       EXTENT  OF  COLLABORATION  AND  PARTICIPATION 

3.  Collaboration 

4.  Participation 

5.  Role  Groups 

6.  Incentives 
Section  C       DESCRIPTION  OF  PROGRAMS 

7.  Necessary  Activities 

8.  Achievement 

Section  D       ASSIGNMENT  OF  RESPONSIBILITY  AND  RESOURCES 

9.  Responsibility  for  Evaluation 

10.  Evaluation  Methods 

11.  Adequacy  of  Documents 

12.  Adequacy  of  Resources 

13.  Availability  of  Resources 
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Following  the  session  plan,  "An  Overview"  (Appendix  D-2) 
and  "Rationale  for  the  Proposed  Criteria"  (Appendix  D-3)  were 
presented  to  the  team  members  and  questions,  if  any,  were  invited 
before  proceeding  to  the  next  step.    Then  the  team  members  were 
asked  to  develop  the  proposed  criteria  making  use  of  the  following 
set  of:    (1)  Instructions,  (2)  Ground  Rules,  and  (3)  Questions  to 
be  Examined. 
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INSTRUCTIONS 

Steps 

1.  Read  the  given  concept  paper. 

2.  Read  each  criterion  as  a  whole. 

3.  Use  the  appropriate  "letter"  given  in  the  checklist  section 
and  rate  each  item  in  the  blank  provided. 

4.  First  rate  sub-items  under  each  criterion  and  then  rate  the 
criterion  as  a  whole. 

5.  Write  comments  using  the  directions  given  in  the  comments  section, 

6.  Share  and  discuss  your  responses  within  a  small  group  and 
prepare  a  group  report. 

7.  Sahre  the  group  reports. 
Checklist  Section 

Each  criterion  consists  of  two  parts:    Checklist  and  Comments. 
The  checklist  has  been  developed  from  provisions,  conditions,  or 
characteristics  outlined  in  Section  231.600  of  the  Florida  Statutes. 

The  use  of  the  checklist  requires  five  letters: 

E  Essential 

D  Desirable 

L  Limited 

M     Not  Essential 

N     Not  Applicable 

Comments  Section 

1.  Comment  upon  clarity  and  essential ness  of  each  criterion. 

2.  Provide  additional  items  which  may  be  needed  to  make  the  criterion 
complete. 

3.  Describe  any  conditions  that  are  omitted  or  inadequately  covered 
by  the  proposed  criteria. 

4.  Clarify  or  amplify  items  in  the  checklist. 

5.  Be  sure  to  number  the  criterion  as  well  as  the  item  commented  on. 
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GROUND  RULES  IN  DEVELOPMENT  OF  CRITERIA 


Criteria  are  defined  as: 

measures  against  which  something  can  be  judged.    They  may 
be  rules,  standards,  norms,  objectives,  or  conditions  of 
behavior  which  are  considered  to  be  "good"  or  "ideal." 
They  provide  a  description  or  image  of  what  a  valuable 
program  is  like,  thereby  assigning  value  to  given  phenomena 
related  to  the  program. 

The  reader  should  remember  that  judgment  is  important  in  using 
criteria  and  that  criteria  are  equally  important  in  developing  judgment. 

1.  It  is  necessary  for  members  of  the  visitation  team  to  keep  in 
mind  the  concept  of  teacher  education  centers  (stated  above)  when 
various  items  of  proposed  criteria  are  being  checked  and  developed. 

2.  When  proposed  criteria  are  being  developed,  factors,  such  as  size, 
type,  and  location  of  school,  should  not  be  permitted  to  justify 
the  failure  of  a  TEC  council  to  develop  evaluation  criteria 
appropriate  to  the  philosophy,  objectives,  and  functions  of  that 


3.  It  is  necessary  to  examine  the  set  of  given  questions  regarding 
the  particular  criteria  in  order  to  clarify  the  intent  and  meaning 
of  criteria. 

4.  The  essential  criteria  for  a  good  criterion  are: 


TEC. 


a.    Shared  Meaning 


Means  the  same  to  evaluators  and 
persons  being  evaluated. 


b. 


Generalizable 


Applicable  to  most  of  the  teacher 
education  centers. 


c. 


Practical 


Can  be  used  easily  to  improve 
operations . 
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Conceptual  View 

In  addition  to  the  instructions,  ground  rules,  and  questions, 

the  team  members  were  presented  with  the  following  four  concept 

papers  (Chapter  III)  at  the  beginning  of  each  of  the  four  sessions: 

A,  B,  C,  and  D,  respectively. 

A:    Teacher  Education  Centers  Rationale  for  Program 
Evaluation  (Appendix  B-2) 

B:    Extent  of  Collaboration  and  Participation 
(Appendix  B-3) 

C:    Program  Description  (Appendix  B-4) 

D:    Assignment  of  Responsibility  in  Evaluation 
(Appendix  B-5) 

The  team  members  were  instructed  to  read  the  concept  papers  and 
consider  them  as  an  important  component  of  the  proposed  criteria. 
Thus  the  two  components,  the  conceptual  view  and  the  criteria  were 
considered  as  two  sides  of  a  coin,  since  they  were  interrelated  and 
essential  for  an  effective  evaluation  of  TEC  programs. 

Comments  of  the  Team  Members 

Keeping  in  mind  the  given  instructions,  ground  rules,  questions, 
and  the  concept  papers,  each  of  the  four  team  members  offered  their 
comments  individually  as  well  as  collectively    through  the  group 
discussions  and  reports.    The  following  are  the  comments  offered  by 
each  of  the  four  teams  in  response  to  each  of  the  13  initially 
proposed  criteria. 
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CRITERION  NO.  1:    The  teacher  education  center  (TEC)  Council 
has  a  policy  statement  which  is  used  to 
facilitate  internal  and  external  evaluation 
of  TEC  programs;  addressing  the  following 
as  a  minimum: 

A.  The  Reasons  for  Evaluation  of 
TEC  Programs 

B.  An  Examination  of  Extent  of 
Collaboration  and  Participation 

C.  A  Description  of  TEC  Programs  to 
be  Evaluated 

D.  Assignment  of  Responsibility  and 
Resources  Needed  for  TEC  Evaluation 


Criteria: 
No.  &  Item 


Comments 
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Section  A:    Rationale  for  Program  Evaluation 
CRITERION  NO.  1:    Statement  of  Pol  icy- -Comments 

Team  No.  1 

-  Add:    (a)  method  of  internal  and  external  evaluation; 

(b)  place  TEC  plays  in  the  overall  effectiveness 
of  the  school  system. 

-  Modify  rating  scale. 

-  Instructions  are  difficult  to  follow  and  are  unclear. 

Team  No.  2 

-  Is  policy  statement  local  or  state? 

-  Policy  statement  should  spell  out  what  is  to  be  measured, 
specific  objectives  to  be  met  and  evaluated. 

Team  No.  3 

-  The  most  essential  sub-items  seem  to  be  "collaboration" 
and  "evaluation." 

-  Criterion  No.  1  is  essential  because:    (a)  gives  bases 
for  evaluation;  (b)  outlines  purposes  and  goals;  and 
(c)  provides  flexibility. 

-  Resources  do  not  seem  appropriate  in  policy  statement. 

-  Is  policy  statement  general  or  specific?  General 
seems  to  be  better. 

Team  No.  4 

-  Change  "policy  statement"  to  "define"  policy. 

-  Policy  statement  is  essential. 
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CRITERION  NO.  2:    The  TEC  Council  regularly  evaluates  its 
programs  to: 

a.  provide  information  for  decisions 

b.  identify  areas  which  need  improvement 

c.  suggest  new  directions  for  program 
modi  fi cation 


Criteria: 
No.  &  Item 


Comments 
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CRITERION  NO.  2:    Regularity  in  Evaluation— Comments 

Team  No.  1 

-  Add:    (a)  relationship  to  instruction 

(b)  ascertain  financial  cost  (or  worth)  of 
TEC  programs 

(c)  feedback  to  collaborators 

(d)  evaluate  the  evaluation  process. 

Team  No.  2 

-  Add:    determine  where  measurable  the  impact  of  TEC 
on  children  and  community. 

-  Confusing  "individual"  or  "particular"  programs? 

-  Some  conflict  -  evaluation  gives  information.  Who 
makes  decision  once  they  have  information? 

-  School  system  -  difficult  in  multidistrict  and  centers. 

Team  No.  3 

-  What  do  you  mean  by  regular  evaluation? 

-  Regularly,  annually,  and  continuously? 

-  Feedback  would  need  to  be  streamlined. 

-  Sub-items  are  rated  essential. 

Team  No.  4 

-  Change  "ascertain"  to  "review". 

-  Definition  of  regularly  is  unclear. 

-  Somewhat  vague.    Whose  decisions?  Council's 
decisions?    Superintendent's  decisions? 

-  Is  DOE  a  collaborating  party?    Where  is  the  state 
council ? 

-  What  type  of  roles:    perceived  or  actual? 
financial?  or  instructional? 
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CRITERION  NO.  3:    The  TEC  Council  evaluates  and  determines 
the  extent  of  collaboration  between  and 
among  the  colleges,  universities,  the 
schools  and  the  community,  in  relation 
to  the  TEC's: 

a.  policies 

b.  objectives 

c.  activities 


Criteria: 
No.  &  Item 


Comments 
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Section  B:    Examination  of  Collaboration  and  Participation 
CRITERION  NO.  3:  Collaboration'-Comments 

Team  No.  1 

-  Add:    (a)  attitudes  of  participants 

(b)  equality  of  membership 

(c)  policies  reflecting  group  cooperation 

(d)  activities  appropriate  for  objectives 
and  clients 

(e)  quality  of  decisions 

-  Define  collaboration,  shared  decision  making. 

Team  No.  2 

-  Add:    shared  resources 

-  Eliminate  the  word  "determine" 

-  TEC  impact  on  college  policy  or  shared  impact  on 
TEC  policy? 

-  Initial  statement  is  unclear. 

-  Attitudes  of  all  role  groups  -  define  role  groups. 

-  All  items  are  essential. 

Team  No.  3 

-  Add:    (a)  teaching  profession 

(b)  community 

-  Insert  "collaborating  units"  in  place  of  "TEC  participants" 

-  Extent  of  collaboration  is  viewed  as  essential. 

-  Group  philosophy  is  that  statement  3  implies  a  "degree" 
which  is  impossible  to  assess  because  collaboration  is 
not  "fixed"  or  "finished"  at  some  point.  Therefore 
change  "extent"  to  "provides  evidence  through"  rather 
than  "in  relation  to." 

Team  No.  4 

-  Should  we  evaluate  provision  for  or  the  "evidence"? 

-  "Policies"  should  be  policy  making  to  reflect  the  degree 
of  collaboration. 

-  Decisions  by  whom?    Council  making  policy  or  TEC  staff  in 
implementing  policy, 

-  All  items  are  essential. 


CRITERION  NO.  4:    The  TEC  Council  examines  the  extent  of 

involvement  and  participation  by  collabor- 
ating members  in: 

a.  identifying  needed  changes  in  TEC 
programs 

b.  designing  and  developing  needed 
changes 

c.  implementing  the  needed  changes 

d.  evaluating  solutions  to  meet  the 
identified  needs 


Cri  teria: 
No.  &  Item 


Comments 
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CRITERION  NO.  4:  Participation--Comments 

Team  No.  1 

-  Change  "numbers"  to  "organizations  and  institutions" 

-  Change  "needed  changes"  to  "programs" 

-  Delete  "changes" 

Team  No.  2 

.-  Add:    (a)  input  for  teacher  training 

(b)  evaluate  long  range  effectiveness 

-  Participation  -  should  involve  both  preservice  and 
inservice  programs 

-  All  items  are  highly  essential 

-  Criterion  is  clearly  stated  and  adequately  covered. 

Team  No.  3 

-  Change  "examines"  to  "reviews  and  describes" 

-  Collaborating  units  must  take  responsibility  for  their 
participation  in  the  work  of  the  council  and  the 
quality  of  the  involvement  of  their  representatives. 

-  Extent  of  participation  -  it  is  important  for  the 
council  to  look  at  the  participation  in  different 
aspects  of  TEC  programs. 

Team  No.  4 

-  Is  participatory  implementation  desirable? 

-  All  items  are  essential. 
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CRITERION  NO.  5:    The  TEC  Council  examines  participation 

in  inservice  activities  or  programs  by 
different  role-groups  such  as: 

a.  classroom  teachers 

b.  preservice  teachers 

c.  paraprofessionals 

d.  principals 

e.  district  central  administrators 

f.  bus  drivers 

g.  cafeteria  workers 

h.  janitorial  staff 

i.  citizens  advisory  committee  members 
j.  school  board  members 

k.  parents 

1 .  others 


Criterion 
No.  &  Item 


Comments 
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CRITERION  NO.  5:    Role  Groups— Comments 

Team  No.  1 

-  Add:    (a)  non-public  school  teachers 

(b)  university  faculty 

(c)  students 

(d)  substitute  teachers 

Team  No.  2 

-  If  TEC  takes  over  all  of  these,  it  will  move  away 
from  basic  teacher  needs. 

-  TEC  has  limited  involvement  in  programs  for  parents, 
school  board,  non-public  staff,  citizen  and  conmittee. 

Team  No.  3 

-  What  is  meant  by  participation:    numbers,  outcomes, 
perception,  met  needs? 

-  Important  for  council  to  look  at  what  extent  each 
group  participated  in  inservice. 

-  Some  felt  that  non-public  school  teachers  should  not 
be  included. 

Team  No.  4 

-  Define  degree  of  participation. 

-  All  items  are  essential. 
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CRITERION  NO.  6:    The  TEC  Council  examines  incentives  for 
participation  in  TEC  programs.  Such 
incentives  include  access  to: 

a.  university  or  college  credit 

b.  opportunity  to  engage  in  profes- 
sional growth  activities 

c.  released  time  from  regular 
responsibilities 

d.  direct  stipend 

e.  salary  increment  or  promotion 

f.  financial  resources  for  individually 
proposed  project  material,  travel, 
etc. 

g.  financial  resources  for  individually 
proposed  research  and  development 


Criteria: 
No.  &  Item 


Comments 


CRITERION  NO.  6:    Incenti ves--Comments 

Team  No.  1 

-  Add:    (a)  inservice  priority 

(b)  incentives  for  university  faculty 

(c)  promotion 

-  Add:    The  TEC  Council  examines  the  effectiveness 
incentives  for: 

1 .  teachers 

2.  paraprofessionals 

3.  university  faculty 

4.  university  students 

Team  No.  2 

-  Nature  of  incentives  should  be  limited 

-  Types --most  important 

-  Released  time  is  essential. 

Team  No.  3 

-  Add:    any  others  served 

-  Insert  "compensation"  in  place  of  "stipend" 

Team  No.  4 

-  Sub-items  are  essential  and/or  desirable. 
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CRITERION  NO.  7:    The  TEC  evaluation  includes  evidence  of 
necessary  activities  such  as: 

a.  Inservice  training  needs  as  perceived 
or  identified  by  classroom  teachers, 
school  district  personnel,  university 
personnel ,  and  other  concerned  groups 

b.  Human  and  material  resources  for 
inservice  education 

c.  Resources  and  experiences  for 
clinical  preservice  teacher  education 

d.  The  entry  or  re-entry  of  educational 
personnel  into  the  teaching 
profession 

e.  The  training  processes  which  are 
based  on  assessment  of  needs 


Criteria: 
No.  &  Item 


Comments 
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Section  C:    Description  of  Programs 
CRITERION  NO.  7:    Necessary  Acti vi ties--Coniments 

Team  No.  1 

-  Add:    observation  of  classroom/instructional  setting 
performance  as  related  to  the  inservice  activities 
which  teachers  participated. 

-  Insert  "available"  for  inservice  education 

-  Training  processes  should  be  defined  as  inservice 
education. 

Team  No.  2 

-  Add:  students 

-  Clarify  entry  or  re-entry  of  educational  personnel. 

-  All  items  are  essential. 

Team  No.  3 

-  Add:  principals 

-  Delete  "evidence  of",  "district" 

-  Needs  assessment  -  should  be  flexible  and  both  formal 
and  informal . 

-  All  items  are  essential. 

Team  No.  4 

-  Are  processes  based  on  needs  or  are  topics  or  programs 
based  on  needs? 

-  Overall  sub-items  are  essential  and/or  desirable. 
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CRITERION  NO.  8:    The  TEC  Council  examines  the  extent  and 

adequacy  of  achievement  in  relation  to:   

a.  short  term  objectives   

b.  long  term  objectives   

c.  the  unintended  effects  of  TEC  programs   


Criteria: 
No.  &  Item 


Comments 
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CRITERION  NO.  8:  Achievement—Comments 

Team  No.  1 

-  Add:    the  transfer  of  learning  from  inservice  to  per- 
manent setting. 

-  All  items  are  essential. 

Team  No.  2 

-  Delete  the  word  "unintended" 

-  Whose  achievement? 

-  Unintended  could  not  be  essential  -  are  objectives 
determined  by  needs  assessment? 

-  All  items  are  essential. 

Team  No.  3 

-  Change  "short  term"  to  "specific" 

-  What  is  meant  by  unintended  effects? 

-  We  don't  think  its  TEC  council's  responsibility. 

-  All  items  are  essential. 

Team  No.  4 

-  What  about  method  of  achievement? 

-  All  items  are  essential. 


CRITERION  NO.  9:    The  responsibility  for  evaluation  of  TEC 
objectives,  activities,  and  outcomes  is 
assigned  to  an  officially  designated  team. 
Such  a  team  is  composed  of: 

a.  persons  with  professional  and/or 
scholarly  background  in  design  and 
measurement  or  evaluation 

b.  persons  who  have  continuing  experience 
in  evaluation  at  elementary,  secondary 
or  university  levels. 


Criteria: 
No.  &  Item 


Comments 


Section  D:    Assignment  of  Responsibility  and  Resources 
CRITERION  NO.  9:    Responsibility  for  Eval uation— Comments 

Team  No.  1 

-  Add  after  "evaluation"  (formative  and  summative, 
internal  and  external) 

-  Insert  "TEC  Council"  in  place  of  "officially" 
"and"  in  place  of  "or" 

Team  No.  2 

-  Add:    persons  with  expertise  such  as  TEC  directors 
and  teachers. 

-  Add:    professional  and  recent. 

Team  No.  3 

-  Add:    evaluation  of  educational  programs 

-  All  items  are  essential. 

Team  No.  4 

-  Selection  of  evaluation  team  members  should  be 
extended  to  council . 

-  All  items  are  desirable. 
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CRITERION  NO.  10:    The  TEC  Council  examines  the  extent  of 

methods  of  evaluation  used  such  as: 

a.  use  of  standardized  tests  or 
instruments 

b.  feedback  from  program  participants 

c.  perception  and  opinions  of  programs 
implementers  or  administrators 

d.  comments  of  an  external  evaluator 


Criteria: 
No.  &  Item 


Comments 
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CRITERION  NO.  10:    Evaluation  Methods--Comments 

Team  No.  1 

-  Add:    (a)  "Where  appropriate"  after  external  evaluator. 

(b)  "criterion  reference  tests",  "survey  data" 

(c)  formal  classroom  observation. 

-  Delete  "extent  of" 

Team  No.  2 

-  Add:    feedback  from  non-participants 

-  All  items  are  essential. 

Team  No.  3 

-  Add:    Non  participants  in  TEC  programs,  who  had  an 
opportunity  to  participate. 

-  All  items  are  essential  and/or  desirable. 

Team  No.  4 

-  Change  "range"  to  "appropriateness" 

-  "Formal  classroom  observation"  seems  limited. 

-  All  items  are  essential  and  desirable. 
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CRITERION  NO.  11:    The  TEC  Council  examines  the  adequacy 

of  documents  used  in  evaluation.  Such 
documents  include: 

a.  objective  description  of  intended 
goals  and  outcomes 

b.  the  personal  judgment  of  an 
officially  designated  team  regarding 
the  quality  and  appropriateness  of 
intended  goals  and  outcomes 

c.  the  objective  descriptions  of  achieved 
goals  and  outcomes 

d.  the  personal  judgments  of  an  official- 
ly designated  team  regarding  the 
quality  and  appropriateness  of 
achieved  goals  and  outcomes 


Criteria: 
No.  &  Item 


Comments 


CRITERION  NO.  11:    Adequacy  of  Documentation--Coniments 

Team  No.  1 

-  Add:    "developed  for"  in  basic  criterion. 

-  Delete  "appropriateness" 

Team  No.  2 

-  The  personal  judgment  -  needs  clarification. 

-  All  items  are  essential. 

Team  No.  3 

-  Personal  judgment?    Judgment  of  team  OK,  but  not  a 
personal  judgment. 

-  All  items  are  essential. 

Team  No.  4 

-  Insert  "evaluation  report"  in  place  of  documents; 
"reviews"  in  place  of  "examines". 

-  Objectivity,  in  this  instance,  will  provide  more 
credibility  than  subjective  response. 
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CRITERION  NO.  12:    The  TEC  Council  annually  examines  the 

adequacy  of  resources  needed  to  meet: 

a.  the  cost  of  services  rendered  in 
the  process  of  internal  evaluation 

b.  the  cost  of  services  rendered  in 
the  process  of  external  evaluation 

c.  the  cost  of  materials  used  in  the 
process  of  evaluation 


Criteria: 
No.  &  Item 


Comments 
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CRITERION  NO.  12:    Adequacy  of  Resources  Available--Connients 

Team  No.  1 

-  Add:    needed  for  evaluation  in  comparison  to  resource 
priorities  and  other  activities. 

-  Insert  "service"  and  materials. 

-  Insert  "internal  and  external  evaluation" 

-  Right-on. 

Team  No.  2 

-  Insert  "available"  in  place  of  "needed" 

-  All  items  are  essential. 

Team  No.  3 

-  All  items  are  essential. 

Team  No.  4 

-  Clarify  the  word  "resources" 

-  All  items  are  essential. 
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CRITERION  NO.  13:    The  TEC  Council  examines  the  avail- 
ability of  outside  resources  to 
support: 

a.  the  internal  evaluation  of  TEC 
programs 

b.  the  external  evaluation  of  TEC 
programs  for  improving  the  quality 
of  education 


Criteria: 
No.  &  Item 


Comments 
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CRITERION  NO.  13:    Availability  of  Outside  Resources-— Conments 

Team  No.  1 

-  Just  fine. 

-  Members  of  teams  should  be  TEC  Council  or  its 
designated  group. 

Team  No.  2 

-  What  are  outside  resources? 

-  All  items  are  essential  and/or  desirable. 

Team  No.  3 

-  All  items  are  essential. 

Team  No.  4 

-  The  third  party  input  should  provide  clear  and 
unemotional  evaluation,  if  it  is  based  on  State 
TEC  Council  objectives,  goals,  or  action  (if 
possible). 

-  All  items  are  desirable. 


68 


Revision  of  Initially  Proposed  Criteria 

Initially,  the  proposed  set  of  criteria  for  the  evaluation  of 
TEC  programs  consisted  of  four  sections:    A,  B,  C,  and  D,  comprising 
the  total  of  13  criteria  and  69  items.    Each  criterion  consisted  of 
two  parts:    a  checklist  and  comments. 

The  proposed  set  of  criteria  was  revised  after  each  team 
visitation  to  the  TEC  sites.    Each  time,  during  the  process  of 
revision,  three  basic  data  sources  guided  the  selection,  retention, 
or  rejection  of  items:    (1)  the  appropriate  responses  and  comments 
offered  by  each  team  participant  regarding  the  checklist,  (2) 
the  group  reports  and  recommendations  submitted  by  team  members 
at  the  end  of  each  session,  and  (3)  discussions  taped  during  the 
presentation  of  group  reports  given  by  small  groups  at  the  end  of 
each  session. 

During  the  process  of  administration  of  criteria,  the  team 
members  were  instructed  to  give  due  emphasis  on  qualitative 
rather  than  quantitative  aspects  of  the  initially  proposed 
criteria.    However,  the  investigator  did  consider  all  the  appro- 
priate additional  items  (see  Table  3)  during  the  process  of  four 
revisions. 
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During  the  process  of  four  revisions  of  the  proposed  criteria, 
the  investigator  observed  the  following: 

1.  The  number  of  sections  and  the  number  of  criteria  initially 
proposed  remained  unchanged. 

2.  Nineteen  additional  items  were  suggested  and  the  total 
number  of  items  v/ere  increased  from  69  to  88  items  (see 
Table  3). 

3.  A  number  of  items  were  rephrased  or  modified  to  convey 
the  appropriate  connotation  of  the  item  proposed. 

4.  A  number  of  new  items  were  included  in  order  to  broaden 
the  concept  of  terms  such  as  "evaluation,"  "collaboration," 
"programs,"  "participation,"  and  "effects." 

5.  Team  members'  comments  and  discussion  brought  about 
qualitative  changes  in  the  set  of  initially  proposed 
cri  teria , 


CHAPTER  IV 

CRITERIA  PROPOSED  FOR  EVALUATION  OF  TEC  PROGRAMS 


The  developed  set  of  criteria  for  evaluation  of  TEC  programs 
examined  the  philosophy,  objectives,  and  functions  of  teacher  educc 
tion  centers  in  relation  to  the  intent  and  purpose  of  the  Teacher 
Education  Center  Act  of  1973.    Thirteen  criteria,  organized  into 
four  sections,  dealt  with  four  major  components  of  TEC  programs. 

Section  A  RATIONALE  FOR  TEC  EVALUATION 

1.  Statement  of  Policy 

2.  Regularity  in  Evaluation 

Section  B  EXTENT  OF  COLLABORATION  AND  PARTICIPATION 

3.  Collaboration 

4.  Participation 

5.  Role  Groups 

6.  Incentives 
Section  C             DESCRIPTION  OF  PROGRAMS 

7.  Necessary  Activities 

8.  Achievement 

Section  D  ASSIGNMENT  OF  RESPONSIBILITY  AND  RESOURCES 

9.  Responsibility  for  Evaluation 

10.  Evaluation  Methods 

11.  Adequacy  of  Documentation 

12.  Adequacy  of  Resources  Available 

13.  Availability  of  Outside  Resources 
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Section  A:    Rationale  for  TEC  Evaluation 


Statement  of  Policy 

The  teacher  education  center  (TEC)  Council  has  a 
policy  statement  which  is  used  to  facilitate 
internal  and  external  evaluation  of  TEC  programs 
and  activities;  addressing  the  following  as  a 
minimum: 

A.  The  Rationale  for  Evaluation  of  TEC  Programs 

B.  An  Evidence  of  Collaboration  and  Participation 

C.  A  Description  of  TEC  Programs  to  be  Evaluated 

D.  Assignment  of  Responsibility  for  Evaluation 
and  Allocating  Resources  Available  for  TEC 
Evaluation 


Regularity  in  Evaluation 

The  TEC  Council  regularly  and  annually  evaluates 
its  programs  and  operations  to: 

a.  Provide  information  for  decisions 

b.  Provide  feedback  to  collaborating  parties, 
e.g.,  university,  DOE,  school  board 
members,  teachers 

c.  Identify  areas  which  need  improvement 

d.  Ascertain  financial  cost  of  TEC  program 
and  practices 

e.  Determine  the  role  TEC  plays  in  improvement 
of  specific  programs 

f.  Suggest  new  directions  for  program 
modification 
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Section  B:    Extent  of  Collaboration  and  Participation 

3.  Collaboration 

The  TEC  Council  evaluates  the  provision  of 
evidence  of  collaboration  betv/een  and  among 
colleges,  universities,  the  schools,  the  teach- 
ing profession,  and  the  community  through  TEC's: 

a.  Pol icies--reflect  and  promote  shared 

decision  making   

b.  Objecti ves--meet  individual  and  shared 

needs  of  collaborating  units   

c.  Activities--appropriate  for  collaborating 

units   

d.  Communication--provides  feedback  between 

and  within  role  groups   

e.  Decisions--sensiti ve  to  the  needs/concerns 
of  participating  institutions/organizations 


Participation 

The  TEC  Council  examines  the  extent  of  involve- 
ment and  participation  by  collaborating  organiza- 
tions and  institutions  in: 

a.  Identifying  needed  programs  for  TEC 
participants 

b.  Designing  and  developing  needed  programs 

c.  Implementing  the  needed  programs 

d.  Evaluating  programs  to  meet  the  identified 
needs 

e.  Evaluating  programs  and  activities  by 
each  of  the  collaborating  units 
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5.  Role-Groups 

The  TEC  Council  examines  participation  in 
inservice  activities  or  programs  by  different 
role-groups  such  as: 

a.  Classroom  teachers/counselors 

b.  Preservice  teachers 

c.  Paraprofessionals 

d.  Principals 

e.  District  central  administrators/supervisors 

f.  Bus  drivers 

g.  Cafeteria  workers 

h.  Custodial  staff /maintenance  workers 

i.  Citizens  advisory  committee  members 
j  .    School  board  members 

k.  Parents 

1.    Substitute  teachers 

m.    Non-public  school  teachers 

n.    Secretarial/clerical  staff 

0.    University  staff 

p.  Others  


6.  Incentives 

The  TEC  Council  examines  provision  of  i ncenti ves 
provided  to: 

a.  Teachers 

b.  Paraprofessionals 

c.  University  faculty 

d.  University  students 

e .  Admi  ni  strators/supervi  sors/pri  nci  pal  s 

f.  School  as  a  unit 

g.  Others   

The  types  of  incentives  include: 

a.  University  or  college  credit 

b.  Opportunity  to  engage  in  professional  growth 
activities 

c.  Released  time  from  regular  responsibilities 

d.  Direct  compensation 

e.  Salary  increment  or  promotion 

f.  Financial  resources  for  individually  proposed 
project  material ,  travel,  etc. 

g.  Financial  resources  for  individually  proposed 
research  and  development 

h.  Inservice  points 


Section  C:    Description  of  Programs 


7.  Necessary  Activities 

The  TEC  evaluation  includes  evidence  of  an 
examination  of  necessary  activities  such  as: 

a.  Inservice  training  needs  as  perceived  or 
identified  by  classroom  teachers,  principals, 
school  district  personnel,  university  per- 
sonnel ,  and  other  concerned  groups 

b.  The  training  processes  which  are  based  on 
assessment  of  needs 

c.  Identifying  and  coordinating  human  and 
material  resources  for  inservice  education 

d.  Utilizing  resources  and  experiences  for 
clinical  preservice  teacher  education 

e.  Facilitation  of  the  entry  or  re-entry  of 
educational  personnel  into  the  teaching 
profession 

8.  Achievement 

The  TEC  Council  examines  the  extent  and  adequacy 
of  TEC  program  achievement  in  relation  to: 

a.  Specific  objectives 

b.  The  intended  effects 

c.  The  unanticipated  effects  of  TEC  programs 
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Section  D:    Assignment  of  Responsibility  and  Resources 

9.    Responsibility  for  Evaluation 

The  responsibility  for  periodic  evaluation  (formative 
and  summative,  internal  and  external)  of  TEC  objec- 
tives, activities  and  outcomes  is  assigned  to  a  TEC 
Council  designated  team.    Such  a  team  should  include: 

a.  Persons  with  professional  knowledge  and/or 
experience  in  design  and  measurement  or 
evaluation  of  educational  programs   

b.  Persons  who  have  recent  experience  in 
conducting  evaluation  at  elementary, 
secondary,  and  university  levels 


10.    Evaluation  methods 

The  TEC  Council  examines  the  appropriateness  of 
methods  of  evaluation  used  such  as: 

a.  Feedback  from  TEC  program  participants 

b.  Feedback  from  non-TEC  program  participants 

c.  Perceptions  and  opinions  of  program 
implementers  or  administrators 

d.  Comments  or  observations  of  an  external 
assessment  team 

e.  Use  of  standardized  or  criterion  referenced 
tests  or  instruments,  where  appropriate 

f.  Formal  classroom  observations 


Adequacy  of  Documentation 
The  TEC  Council  examines  the  adequacy  of  the 
documents  developed  for  and  used  in  evaluation. 
Such  documents  include: 

a.  Objective  description  of  intended  goals  and 
outcomes 

b.  The  personal  judgments  of  members  of  a  TEC 
Council  designated  team  regarding  the 
quality  of  intended  goals  and  outcomes 

c.  The  objective  descriptions  of  achieved 
goals  and  outcomes 

d.  The  personal  judgments  of  members  of  a  TEC 
Council  designated  team  regarding  the 
quality  of  achieved  goals  and  outcomes 
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12.  Adequacy  of  Resources  Available 

The  TEC  Council  annually  examines  the  adequacy 
of  resources  available  for  evaluation  in  compari- 
son to  resource  priorities  and  other  activities 
to  meet: 

a.  The  cost  of  services  rendered  and  materials 
provided  in  the  process  of  internal 
evaluation 

b.  The  cost  of  services  rendered  and  materials 
provided  in  the  process  of  external 
evaluation 

13.  Availability  of  Outside  Resources 

The  TEC  Council  examines  the  availability  of 
outside  resources  to  support: 

a.  The  internal  evaluation  of  TEC  programs 

b.  The  external  evaluation  of  TEC  programs 
for  improving  the  quality  of  education 


CHAPTER  V 


SUfWRY,  RESULTING  CRITERIA,  RECOMMENDATIONS 
AND  NEED  FOR  FURTHER  RESEARCH 

Summary 

Two  problems  have  been  addressed  in  this  study,  the  identifi- 
cation of  criteria  for  evaluation  of  teacher  education  centers  as 
outlined  in  Section  231.608  of  Florida  Statutes  and  the  development 
of  those  criteria  based  on  the  conceptual  framework  provided  by 
Stake  (1977)  for  responsive  evaluation. 

The  scope  of  the  investigation  centered  upon  the  identified 
provisions  of  sections  231.603  and  231.608(1),  Florida  Statutes, 
The  Teacher  Education  Center  Act  of  1973,  and  the  annual  reports 
submitted  by  the  existing  teacher  education  centers  during  the 
period  1974-1979.    In  addition  to  the  legislation  and  annual 
reports,  the  study  focused  on  conceptual  views  advocated  by  Stake 
(1977),  Cahen    (1971),  and  Drummond  (1978). 

The  study  involved  three  major  steps:    (1)  the  conceptual 
evaluation  plan,  (2)  the  status  report  based  on  the  document 
search,  and  (3)  the  team  visitations  to  TEC  sites. 
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The  conceptual  evaluation  framework  proved  helpful  in  the 
identification  of  13  criteria  and  88  items  associated  with  and 
addressing  four  major  components  in  TEC  evaluation:    (1)  the 
rationale  for  TEC  evaluation,  (2)  the  extent  of  col laboration 
and  participation,  (3)  the  description  of  programs,  and  (4)  the 
assignment  of  responsibility  and  resources. 

Cahen    (1971)  and  Stake  (1967b)  both  emphasized  program 
evaluation  as  a  process,  a  "rational  process"  to  be  used  for 
decision  making.    Stake  and  Denny  (1959,  p.  370)  stressed  the 
need  for  clarity  and  the  understanding  of  the  rationale  behind 
evaluation: 

Evaluation  is  not  a  search  for  cause  and  effect,  an  in- 
ventory of  present  status,  or  a  predication  of  future 
success.    It  is  something  of  all  of  these  but  only  as  they 
contribute  to  understanding  substance,  function  and  worth. 

However,  the  evaluative  criteria  presented  in  this  study  have  been 

identified  and  developed  not  only  to  examine  the  worth,  effectiveness, 

and  adequacy  of  TEC  programs  but  also  to  obtain  information  useful 

for  decision  making  and  program  improvement. 

An  examination  and  review  of  the  TEC  documents  in  relation  to 

the  evaluation  of  TEC  revealed  the  heavy  emphasis  on  quantitative 

assessment,  both  at  the  local  as  well  as  state  TEC  Council  levels. 

The  need  for  developing  the  qualitative  criteria  has  been  emphasized 

as  a  priority  issue.    Thus,  the  criteria  presented  in  this  study 

aimed  at  the  qualitative  rather  than  quantitative  measures.  The 

checklist  developed  from  provisions,  conditions,  or  characteristics 

outlined  in  Section  231.600  of  the  Florida  Statutes  required  the  use 
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of  five  qualitative  measures:    E=Essential ;  D=Desirable;  L=Limited; 
M=Not  Desirable;  and  N=Not  Applicable.    In  addition  to  the  check- 
list, the  comment  section  provided  at  the  end  of  each  criterion  also 
facilitated  qualitative  responses. 

The  final  step  in  the  study,  namely  the  team  visitations  to 
TEC  sites,  provided  an  opportunity  for  representatives  of  the 
educational  community  to  re-examine  the  purposes  and  potential  of 
TECs  in  Florida  and  stimulated  communication  among  and  between  the 
different  role-groups  having  a  stake  in  TEC  program  evaluation. 

The  three  centers  selected  at  random  for  team  visitation  were 
the  Alachua  TEC,  the  Northeast  TEC,  and  the  Polk  County  TEC.  A 
total  of  65  TEC  members,  representing  nine  different  role-groups: 
(1)  teachers,  (2)  principals,  (3)  administrators,  (4)  TEC  directors, 
(5)  citizens,  (6)  college  professors,  (7)  school  board  members, 
(8)  DOE  representatives,  and  (9)  teacher  organization  representatives 
directly  participated  in  the  process  of  developing  the  criteria  for 
TEC  evaluation.    For  this  purpose,  the  use  of  the  responsive  evalua- 
tion approach  advocated  by  Stake  (1977)  helped  in  providing  differ- 
ent value  perspectives  presented  by  the  nine  different  role-groups. 

The  responsive  approach  is  "an  attempt  to  respond  to  the  natural 
ways  in  which  people  assimilate  information  and  arrive  at  under- 
standings"   (Stake,  1977,  p.  164).    Thus  the  responses  from  nine 
different  role-groups  were  not  viewed  as  answers  but  as  perspec- 
tives shared  in  the  process  of  development  of  criteria  for  TEC 
evaluation. 
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Resulting  Criteria 

Finally,  the  following  is  the  developed  set  of  criteria  for 
the  evaluation  of  TEC  programs  in  Florida: 

1.  The  existence  of  a  policy  statement  to  facilitate  and 
govern  internal  and  external  evaluation  of  TECs. 

2.  Regularity  in  TEC  evaluation,  and  the  role  the  TEC 
plays  in  modifying  and  improving  its  own  programs. 

3.  Collaboration  between  and  among  participating  units, 
evidence  provided  through  TECs'  policies,  objectives, 
activities,  communication,  and  decisions. 

4.  Participation  by  collaborating  units  in  identifying, 
implementing,  and  evaluating  programs. 

5.  Participation  of  different  role  groups  in  the  programs 
offered. 

6.  Provision  and  clarification  of  incentives  provided  to 
different  role-groups. 

7.  Evidence  that  there  has  been  an  examination  of  necessary 
activities  needed  for  inservice  and  preservice  education. 

8.  Review  of  the  extent  and  adequacy  of  TEC  program  achieve- 
ment in  relation  to  specific  objectives  and  intended  effects. 

9.  The  assignment  of  responsibility  for  evaluation  and  the 
nature  and  composition  of  evaluation  teams. 

10.    Evidence  that  the  TEC  Council  has  examined  the  appro- 
priateness of  methods  used  for  TEC  evaluation. 
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11.  The  adequacy  of  documentation  developed  and  used  in 
TEC  evaluation. 

12.  The  adequacy  of  resources  provided  to  meet  the  cost 

of  materials  used  and  services  rendered  in  evaluation. 

13.  The  availability  of  outside  resources  for  internal  and 
external  evaluation  of  TEC  programs. 

Recommendations 

Participants  in  the  team  visitations  recommended  the  following 
actions  in  their  small  group  reports: 

1.  These  evaluation  criteria  should  be  sent  to  the  State  TEC 
Council  for  review. 

2.  State-wide  recommendations  should  emanate  from  the  review 
of  all  local  evaluations. 

3.  Sufficient  training  should  be  provided  to  evaluators  in 
using  these  criteria. 

4.  A  copy  of  the  adopted  criteria  and  materials  should  be 
sent  to  each  team  participant. 

5.  An  on-going  training  program  for  council  members  should 
be  organized. 

6.  The  process  used  in  this  study  should  be  recommended  as 
the  process  to  be  used  by  local  TEC  Councils. 

7.  The  process  model  developed  in  this  study  should  be 
continued  throughout  the  state  as  a  way  of  understanding 
and  evaluating  TECs. 

8.  The  model,  when  adopted,  should  be  kept  flexible  and  general. 


Need  for  Further  Research 


flany  avenues  may  be  explored  in  evaluating  the  effectiveness 
of  TEC  programs;  however,  the  comments  offered  by  team  members  on 
the  checklist  and  the  discussions  held  with  the  TEC  Council 
members  during  the  course  of  the  study    indicated  that  the  role 
played  by  the  evaluator  is  a  key  factor  for  successful  evalua- 
tion of  TEC  programs. 

A  study  should  be  made  of  the  evaluator 's  role  in  relation 

to  his/her  qualifications,  experience,  training  activities,  etc. 

as  the  factors  contributing  to  the  effectiveness  of  evaluation  of 

TEC  programs.    Stake  and  Denny  indicated  the  importance  of  the 

evaluator  when  they  commented: 

Before  considering  the  needs  for  new  evaluation 
methodology,  we  wish  to  acknowledge  that  the  success- 
ful use  of  methods  depends  on  the  people  who  use 
them.  (Stake  &  Denny,  1969,  p.  371) 


APPENDIX  A-1 


REPORT  ON  THE  STATUS  OF 
TEACHER  EDUCATION  CENTERS 
AS  OF  JUNE  12,  1978 


Areas  of  no  TEC. 


St«tt  of  F^io'ida 
0«p«Mment  of  EduCitton 

R*loh  0,  Tuftmqion,  Commttioner 


90 


1 

I 

i 


APPENDIX  A-2 

A  PROPOSED  STUDY  TO  EVALUATE  TEACHER  EDUCATION 
CENTER  PROGRAMS  IN  FLORIDA 

The  teacher  center  movement  in  the  State  of  Florida  represents 
a  significant  effort  to  improve  public  education.    Greater  attention 
should  be  given  to  evaluating  the  programs  carried  out  in  Teacher 
Education  Centers  and  monitoring  the  collaborative  process  used  in 
teacher  education  center  approaches  (FTEC:    A  Review  of  Policy  and 
Policy  Implementation,  May,  1977).    This  creates  a  need  for  develop- 
ing qualitative  procedures  for  program  evaluation  which  will  foster 
an  understanding  of  the  objectives,  activities,  standards,  and 
judgments  followed  in  carrying  out  the  TEC  programs  in  Florida  and 
also  provides  a  means  for  self  study  and  self  improvement.  The 
proposed  study  is  designed  to  fulfill  that  need. 

Such  an  evaluative  effort  will  consider  seven  major  components: 
Program  purposes,  content,  environments,  methods,  intended  changes, 
standards,  and  judgments.    An  attempt  will  be  made  to  answer  the 
following  questions: 

1.  What  is  the  rationale  behind  TEC  programs?    How  are  major 
goals  and  priorities  set?    What  efforts  are  made  to  improve  TEC 
programs? 

2.  What  strategies  are  being  used  in  making  decisions?  How 
are  schools  and  community  resources  utilized  in  TEC  programs?  What 
are  TECs  doing  to  facilitate  collaboration  in  decision-making? 
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3.  In  carrying  out  their  missions  what  changes  are  hoped  for 
or  intended  through  TEC  programs  and  activities?    To  what  extent  are 
TEC  programs  congruent  with  and  reflective  of  the  diverse  needs 

and  interests  of  the  teachers  and  pupils  they  serve? 

4.  How  are  TEC  programs  evaluated?   What  evaluative  criteria 
are  being  utilized  for  improving  TEC  programs?    How  are  feedback  data 
being  used? 

5.  How  are  programs  judged:    (1)  by  those  who  are  involved  with 
them  and  (2)  by  those  who  have  expertise  in  the  program  areas?  What 
is  the  ultimate  rationale  behind  their  judgment? 

Procedure 

A  layout  of  statements  and  data  will  be  collected  by  the 
evaluator  using  the  following  Data  Matrices: 

Data  Matrices 


Intents     Observations       Standards  Judgments 


Rationale 


Antecedents 


Transactions 


Outcomes 


Description  Matrix 


Judgment  Matrix 
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The  teacher  education  center  programs  will  be  evaluated,  using 
a  case  study  approach  and  Stake's  model. 

This  study  is  designed   to  last  one  year  and  intends  to  produce 
a  final  report  in  the  form  of  a  book-length  manuscript  ready  for 
publication  entitled:    Florida  Teacher  Education  Center  Programs 
(An  Evaluative  Study). 
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AN  ANALYSIS  OF  THE  TYPE  OF  STUDY 
TO  BE  USED  IN  EVALUATION  OF  PROGRAMS 


Approach: 
Definition: 

Study  Types: 
Purpose: 


Source  of 
Questions: 

Main  Questions: 


Typical 
Methods: 

Pioneer: 

Developer: 


Value  Orientation  (True  Evaluation) 

Study  that  is  designed  primarily  to  assess 
some  object's  worth 

Localized  concerns  and  issues 

To  foster  an  understanding  of  activities 
and  how  they  are  valued  in  a  given  setting 
and  from  a  variety  of  perspectives 

Community  and  practitioner  groups  in  local 
environments  and  educational  experts 

What  is  history  and  status  of  a  program 
and  how  is  it  judged  by  those  who  are  in- 
volved with  it  and  those  who  have  expertise 
in  the  program  areas? 

Case  study,  adversary  reports,  sociodrama, 
responsive  evaluation 

R.  E.  Stake 

MacDonald,  Rippy  and  Guba 
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Action  Plan  for  Ten  Weeks 
(12-1-78/2-15-79) 


Document  Search  by 
Investigator 


Proposal  of  Initial  Criteria 

by  Investigator 

> 

f 

Try  Out  of  Criteria  By 

Team  No.  1 

First  Revision  of  Tried-Out 
Criteria  by  the  Investigator 


Try  Out  of  Criteria  By 
Team  No.  2 


Second  Revision  of  Tried-Out 
Criteria  by  the  Investigator 


Try  Out  of  Criteria  By 
Team  No.  3 


Final  Report  on 
Criteria  for  Evaluation  of  TEC 


3  weeks 


4th  week 


5th  week 


6th  week 


7th  week 


8th  week 


9th  week 


lOth  week 


APPENDIX  B-2 
RATIONALE  FOR  PROGRAM  EVALUATION 


Program  evaluation  is  a  process  by  which  relevant  data  are 
collected  and  transformed  into  information  which  can  be  used  for 
decision-making.    Cahen  (1971)  defines  evaluation  as  a  "rational 
process"  of  reaching  a  decision  about  the  worth  of  something.  The 
"something"  may  be  the  quality  of  a  new  version  of  a  science  program 
or  curriculum,  a  film  strip,  a  new  model  of  the  tape  recorder  to  be 
used  in  schoolrooms,  a  teaching  method,  etc. 

According  to  Harris  (1968),  evaluation  is  "the  systematic 
process  of  judging  the  worth,  desirability,  effectiveness,  or 
adequacy  of  something  according  to  definite  criteria  and  purposes. 
He  gives  six  basic  steps  in  evaluation: 

1.  Decide  what  to  evaluate. 

2.  Determine  the  purpose  or  role  of  the  thing  which  is 
to  be  evaluated. 

3.  Establish  criteria  traits  and  standards. 

4.  Collect  observation  data. 

5.  Compare  the  observation  data  with  the  criteria 
standards . 

6.  Draw  conclusions  relative  to  the  extent  to  which  the 
observation  traits  measure  up  to  the  criteria  standards. 
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Reasons  for  Evaluation 

What  should  the  evaluation  of  teacher  education  programs 
encompass?   The  answers  given  to  the  question  by  experts  in  the 
field  vary  widely.    It  is  possible,  however,  to  list  some  of  the 
reasons  on  which  there  is  wide,  if  not  universal,  agreement,  such 
as : 

1.  The  primary  purpose  for  evaluating  teacher  education 
programs  is  to  provide  information  which  can  be  used  in  making 
decisions  about  the  programs. 

2.  Evaluation  should  be  useful  in  helping  people  see  how 
programs  can  be  improved,  rather  than  being  used  extensively  for 
terminal  decisions. 

3.  Evaluation  should  be  used  for  describing  and  judging  the 
nature  and  quality  of  educational  programs. 

4.  Evaluation  efforts  should  be  helpful  to  examine  short-term 
and  long-term  objectives  as  well  as  the  intended  and  unintended 
effects  of  the  program. 
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Teacher  Education  Centers  --  A  Concept 


A  first  essential  in  developing  proposed  criteria  for  TEC 
program  evaluation  is  to  bear  in  mind  the  philosophy, 
objectives  and  functions  of  teacher  education  center 
programs.    The  teacher  education  center  programs  include 
the  following: 

-  Career-long  teacher  education  to  help  teachers  keep  pace 
with  the  changing  and  diversified  systems  of  instruction 
(continuity  between  preservice  and  inservice). 

-  Cooperation  and  collaboration  among  teachers,  school 
districts,  and  colleges  or  universities  which  allow  for 
the  emergence  of  new  training  strategies  and  procedures. 

-  Commitment  to  shared  power  among  involved  agencies  to 
encourage  new  kinds  of  collaborative  models. 

-  Pooling  of  resources  in  an  organized  effort  to  promote 
wide-spread  use  of  new  educational  material  and  equipment 
for  greater  benefits  for  each  agency  in  the  teacher  educa- 
tion center. 

-  Field  based  preservice  teacher  education  to  provide  greater 
involvement  in  actual  on-going  classroom  experiences. 

-  Broader  focus  on  inservice  training  to  maintain  skills  for 
present  roles  and  prepare  for  new  roles  and  responsibilities. 
(State  Council  for  Teacher  Education  Centers,  1975,  p.  2) 


APPENDIX  B-3 
THE  EXTENT  OF  COLLABORATION  AND  PARTICIPATION 

The  purposes,  intent,  and  policy  of  the  Teacher  Education 
Center  Act  of  1973  indicates  that  teacher  education  is  best  carried 
out  through  the  collaborative  efforts  of  the  colleges  and  univer- 
sities, the  schools,  and  the  community. 

In  order  to  view  the  collaborative  efforts  as  "a  challenge", 
more  than  "contractual  cooperation",  Drummond  and  Nuernberger  (1974) 
have  listed  the  requirements  of  collaboration: 

1.  Some  comnon  goals,  some  mutual  pay-off 

2.  Equitable  power 

3.  Commitment  to  cooperation 

4.  Openness  to  the  influence  of  others,  shown  by  a 
willingness  to  change  one's  outlook,  expectations, 
and  ways  of  working 

5.  Clear  assignment  of  roles  and  responsibilities 

6.  Agreeable  acceptance  of  assigned  roles  and 
responsibilities 

7.  Structure  which  provides  participant  freedom  to  make 
the  necessary  day-to-day  decisions  to  keep  the  project 
moving,  to  act  independently 

8.  More  time,  more  money  and/or  the  reallocation  of  the 
resources 

9.  Continuing  innovation,  stimulating  enterprise  to  keep 
the  venture  from  dying  of  boredom. 
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The  literature  on  collaboration  reveals  that  the  most 
important  requisite  for  successful  collaboration  is  "the  ability 
of  participating  members  to  communicate  meaningfully." 

Edelfelt  and  Lawrence  (1975)  advocate  "deliberate  interventions" 
to  promote  collaborative  efforts  in  inservice  education.  They 
suggested  strategies  such  as:    consciousness  raising;  identification 
of  institutional  and  personal  interest,  including  the  hidden  as  well 
as  the  obvious  agenda;  dialogue  among  all  parties  about  common 
interests  and  priorities;  consensus  on  the  specific  areas  of  collabora- 
tion to  be  tried  and  specific  roles  to  be  assigned;  establishment  of 
a  support  system;  and  trial  efforts  with  built-in  adjustment  pro- 
cedures. 

Using  the  Stake's  terminology,  Reed  (1978)  designed  an  instru- 
ment to  aid  in  the  examination  of  the  collaborative  process.  She 
believed  that  the  use  of  the  designed  instrument  should  allow  the 
teacher  education  centers  to  address  three  questions: 

1.  What  criteria  must  be  present  in  order  to  have  successful 
collaboration  between  individuals  and  interest  groups? 

2.  Is  there  congruence  between  the  TEC  participants'  intents 
(values)  as  they  relate  to  collaboration,  and  their  per- 
ceptions, as  they  relate  to  the  center's  collaboration  and 
experts'  standards? 

3.  If  there  is  not  congruence,  are  the  participants'  intents 
unrealistic  or  is  the  collaboration,  as  perceived  by  the 
participants,  insufficient? 

Reed  hoped  that  the  instrument  would  provide  teacher  education 

centers  with  some  "direction"  for  improving  their  collaborative 

efforts. 


APPENDIX  B-4 
PROGRAM  DESCRIPTION 


Fogel  (1973)  assumes  that  the  success  of  a  program  can  be 
determined  by  measuring  the  difference  between  "stated"  goals 
and  "actual  achivement"  of  those  goals.    Stake  (1977)  takes  an 
innovative  and  suggestive  approach  to  the  problem  of  formal 
evaluation.    He  offers  a  conceptual  background  for  developing 
a  plan  for  "educational  programs"  rather  than  for  "educational 
products",  and  in  doing  so  he  recommends,  "responsive  evaluation". 

According  to  Stake,  an  educational  evaluation  is  "responsive 
evaluation"  if: 

1.  it  orients  more  directly  to  program  activities  than  to 
program  intents; 

2.  it  responds  to  audience  requirements  for  information; 
and 

3.  the  different  value-perspectives  present  are  referred  to 
in  reporting  the  success  and  failure  of  the  program. 

The  two  "basic  acts"  of  evaluation,  according  to  Stake,  are: 
1-    Objective  descriptions  of  goals,  environments,  personnel, 

methods  and  content,  and  outcomes. 
2.    Personal  judgments  as  to  quality  and  appropriateness  of 

those  goals,  environments,  personnel,  methods  and  outcomes. 

Both  the  acts,  "description  and  judgment"  are  essential,  if 

educational  programs  are  to  be  understood  and  improved. 
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APPENDIX  B-5 
ASSIGNMENT  OF  RESPONSIBILITY  IN  EVALUATION 


Finally,  a  related  question  to  the  issue  of  evaluative  criteria: 
Who  evaluates?    Scriven  (1967)  suggested  that  staff  or  team  evalua- 
tors  be  heavily  involved  in  the  formative  stage  while  an  independent 
body  of  evaluators  with  no  personal  commitment  to  the  product  come 
in  and  serve  as  the  summative  evaluators.    Baker  (1974)  remarked  that 
the  persons  most  qualified  to  conduct  formative  evaluation  are  the 
development  staff  themselves.    Drummond  (1978)  commented  that  one  of 
the  norms  which  characterizes  an  effective  policy-making  group  is 
.  .  .  the  work  of  the  Policy  Board  is  assessed  and  evaluated 
annually  by  an  "outside  evaluator". 

Anderson,  Ball,  Murphy,  and  Associates  (1975)  suggest  the  use 
of  different  opposing  strategies  by  the  evaluators,  for  acquiring 
useful  data  and  judgments  in  the  process  of  evaluation.  The 
opposing  strategies  are: 

1.  Formative  vs.  summative— focusing  on  feedback  for  program 
improvement  versus  evaluation  of  the  overall  outcomes  of 
the  program. 

2.  Comparative  vs.  absol utist— judging  results  in  comparison 
with  performance  of  another  group  versus  judging  results 
in  terms  of  some  fixed  standards  related  to  program 
objectives. 
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3.  Internal  vs.  external— conducted  by  members  of  the 
program  staff  versus  outside  evaluators.  - 

4.  Experimental  vs.  quasi -experimental —the  "true" 
controlled  experiment  versus  designs  with  inevitable 
equivocality  caused  by  the  absence  of  randomization. 

5.  Extended  vs.  constrained--where  the  evaluator  feels  a 
freedom  to  go  beyond  the  immediate  time  span  and  the 
assumptions  of  the  particular  program  to  be  evaluated 
versus  the  evaluator  restricting  his  efforts  to  establish 
conditions,  assumptions,  and  "real"  program  time. 

In  addition  to  the  use  of  different  opposing  strategies, 
Anderson,  Ball,  Murphy,  and  Associates  have  listed  a  number  of 
roles  that  evaluators  may  play  depending  on  the  situations  and 
personalities  of  the  participants  in  the  process  of  evaluation. 
The  different  roles  described  are:    Evaluator  as  judge,  juror, 
defendent,  attorney,  expert  witness,  detective,  social  worker,  and 
court  reporter. 

While  commenting  upon  different  roles,  Anderson  et  al, 

advocate  the  role  of  expert  witness  as  a  "proper"  one  for  an 

evaluator.    Further  they  contend: 

To  hide  one's  results  and  conclusions  for  fear  of  attack 
is  regrettable;  to  hide  them  and  then  criticize  the  final 
decisions  is  deplorable;  but  to  present  them  voluntarily, 
honestly,  and  openly--that  seems  to  us  the  mark  of  a 
professional . 


APPENDIX  B-6 


SUMMARY  OF  TEACHER  EDUCATION  CENTER 
ANNUAL  REPORTS  1977-78 
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1.    CENTER  OPERATION: 
Staff  FTE: 
Director 

Other  Prof.  Staff 
Secretarial 

Other 
Council  Membership 
Council  Meetinq  (No.) 
Meeting  Held: 

During  School  Day 

After  Hours,  Compensated 

ATier  Hours,  No  Como. 

2.  OBJECTIVES: 

Nui-bor  r«t 
Number  Unmet 

Will  Meet  78-79 

3.  PARTICIPATION: 

No.  Proqrams/No.  Participants 

ClassroorTi  Teachers 

Other  School  based  Professionals 

Non-Certificated 

District  Adn/Suovr. 

University  and  tC 

Interns 

Volunteers 

Other  Cormunity  Reps. 
4.    REVENUE  m  EXPENDITURES: 

Revenue 
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77-  78  Iti-P  Funds 
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Expenditures 
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Ob.ect  200 
Object  300 
Object  500 
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Object  ;W 

Object  8"J 

Tom  

Carryover  to  1978-79 
Portion  of  $5  FEFP 

Available  to  TEC 
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APPENDIX  C-1 
A  LETTER  TO  THE  VISITING  TEAH  MEMBERS 


December  7,  1978 


Dear  Director: 

It  gives  us  great  pleasure  to  inform  you  that  your  center  has  been 
selected  as  a  practical  base  for  development  of  criteria  for  evalua- 
tion of  TECs  in  Florida.    A  set  of  criteria  has  been  developed  by 
Dr.  Zohra  Setranjiv;alla  under  the  able  guidance  of  Dr.  U.  H. 
Drummond.    A  visiting  team  would  be  happy  to  try  out  the  developed 
set,  at  your  site.    A  tentative  plan  is  as  follows: 

Tentative  Plan  for  Team  Visiting 


1 .    Number  of  teams  and  number 
of  members 


2.    Nature  of  representation  on 
each  team 


3.    Time  schedule  and  centers 


4.    Functions  of  team  members 


5.  Budget 


3  teams  consisting  of 
7  members  each 
3  X  7  =  21  members 

1  member  from  school  districts 
1  member  from  DOE 
1  member  from  university 
1  member  from  teacher 

organization 
3  members--school  teachers 

Jan.  11,  1979,  Alachua  Team  No.  1 
Jan.  18,  1979,  Northeast  Team  No.  2 
Jan.  25,  1979,  Polk  Team  No.  3 

Try  out  the  proposed  criteria  at 
the  site  and  submit  their  comments 
on  criteria. 

The  necessary  travel  and  per  diem 
will  be  paid  to  each  visiting 
team  member. 
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As  you  are  aware,  a  systematic  evaluation  of  TECs  in  Florida  is 
the  major  concern  with  all  of  us.    The  proposed  project  "Develop- 
ment of  Criteria  for  Evaluation  of  TECs,"  has  been  endorsed  by  the 
members  of  the  State  Council  for  Teacher  Education  Centers  in  the 
last  February  meeting  and  it  has  also  been  resolved  that  the  said 
project  should  receive  adequate  and  necessary  support  from  all  the 
TEC  Council  members  in  Florida. 

We  request  you  to  approve  our  plan  and  seek  the  necessary  coopera- 
tion from  your  TEC  Council  members  to  assist  us  in  our  team  visit. 
We  hope  to  succeed  in  our  endeavor  with  your  cooperation  and 
guidance. 

Please  contact  us  at  (904)  372-2392  for  further  information. 

Sincerely  yours, 


James  Parris,  Associate 
Teacher  Education  Centers 


Zohra  Setranjiwalla 
University  of  Florida 


APPENDIX  C-2 
CREATE  TEC  VISITATION 


January  11,  1979 


Visiting  Team 


James  Croteau 
James  Parris 
Bob  Rothberg 
Rod  Davis 

Charlotte  Springfield 
Frances  Stewart 
John  Beall 
Bill  Drummond 


10:00  -  3:00 


Leon  County  TEC 
Department  of  Education 
Central  Florida  University 
PEA 

Leon  County 
Osceola  County 
Osceola  County 
University  of  Florida 


CREATE  Council  Member  Representatives 


Faye  Cake 
Louis  Dunbar 
Jean  McCall 
Diane  Pavonka 
Karen  Jeeter 
Bob  Van  Winkle 
Lamar  Simmons 
Bill  Evans 
Sally  Larson 
Charles  Henderson 


Director 

Teacher 

Teacher 

Teacher 

Teacher 

Principal 

Principal 

Alachua  County  Schools 
Ci  ti  zen 

University  of  Florida 


Session  Leader 
Zohra  Setranjiwal la  University  of  Florida 
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APPENDIX  C-3 
NORTHEAST  TEC  CONSORTIUM  VISITATION 


January  17,  1979 


10:00  -  3:00 


Visiting  Team 


Jean  Horton 
Art  Collier 
Tim  Sullivan 
Molly  Sample 
Jan  Lord 
Janet  Keskiner 
Steve  LeGrande 
Bill  Drummond 


Mideast  TEC 

Department  of  Education 
University  of  Central  Florida 
FTP 

Mideast  TEC 
Clay  County 
Clay  County 
University  of  Florida 


Northeast  TEC  Council  Member  Representatives 


Mike  Purrington 
Craig  Benson 
Dick  Conkling 
Betty  Crippen 
Valdine  Bassett 
Wayne  Erickson 
Molly  Wilkinson 
Preston  Hardin 
Lucille  Payne 


Di  rector 

Administration 

Administration 

University  of  North  Florida 

Teacher 

Teacher 

Teacher 

Teacher 

Administration 


Session  Leader 
Zohra  Setranjiwal la  University  of  Florida 
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APPENDIX  C-4 
POLK  COUNTY  TEC  VISITATION 


January  25,  1979 


10:00  -  3:00 


Visiting  Team 


Ward  Thomas 
Lou  Morel li 
P.  C.  Wu 
Claudia  Thomas 
Ermil  Stohler 
Judy  Westfall 
Robert  Peary 
Bill  Drummond 


Pinellas  County 
Department  of  Education 
University  of  West  Florida 
FTP 

Collier  County 
Pinellas  County 
Highlands  County 
University  of  Florida 


Polk  County  TEC  Council  Member  Representatives 


Bill  Wooldridge 
Marvin  Holt 
Joe  Stevens 
Betty  Longerich 
Greta  Jones 
Gene  Curry 
Tess  Dull 
Marie  Whitney 
Jim  Dickinson 
Myra  West 
Jim  Miles 


Teacher 

Teacher 

Teacher 

Teacher 

Teacher 

Principal 

Administration 

Admini  strati on 

University  of  South  Florida 

Citizen 

Director 


Session  Leader 
Zohra  Setran.iiwalla  University  of  Florida 
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APPENDIX  C-5 
STATE  TEC  COUNCIL  EVALUATION  TEAM 


February  8,  1979 


Tallahassee,  Florida 


GROUP  1 

Mrs.  Gwendolyn  C.  Batie 
Mr.  Ralph  A.  Hinkle 
Dr.  Finn  Groover 
Dr.  Roger  Wilk 

GROUP  2 

Mrs.  Margaret  Cash 
Ms.  Beverlyn  S.  Baines 
Mrs.  Marie  Kohler 

GROUP  3 

Mr.  Phil  Larson 
Mrs .  Joy  Mercer 
Dr.  L.  Linton  Deck 
Mrs.  Rayma  Page 

GROUP  4 

Mrs.  Marvalene  Sage 
Mr.  Ermil  Stohler 
Dr.  Robert  Hendricks 

Session  Leader: 

Zohra  Setranjiwalla 


Teacher 
Principal 

Department  of  Education 
College  of  Education 


Teacher 
Teacher 

Department  of  Education 


Teacher 
Teacher 
Superintendent 
School  Board  Member 


Teacher 
Teacher 

College  of  Education 


University  of  Florida 
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APPENDIX  D-1 
SESSION  PLAN  FOR  THE  DAY 


Session  I  10:30-11:10  (40  minutes) 

1.  Have  an  Overview  of  the  Concepts:  5  minutes 

a.  Teacher  Education  Centers  -  A  Concept 

b.  Rationale  for  Program  Evaluation 

2.  Respond  Individually  to  Criteria  Items  10  minutes 
in  Section  A,  usinq  the  given 

a.  Instructions 

b.  Groundrules 

c.  Questions 

3.  Share  and  discuss  your  responses  within  15  minutes 
a  small  group  and  prepare  a  group  report 

4.  Share  the  group  reports  10  minutes 

COFFEE  BREAK    11:10  -  11:25 


Session  II  11:25-12:20  (55  minutes) 

1.  Have  an  Overview  of  the  Concept:  5  minutes 
Extent  of  Collaboration  and  Participation 

2.  Respond  individually  to  criteria  items  15  minutes 
in  Section  B  using  the  given 

a.  Instructions 

b.  Groundrules 

c.  Questions 

3.  Share  and  discuss  your  representation  20  minutes 
within  a  small  group  and  prepare  a 

group  report 

4.  Share  the  group  reports  10  minutes 
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Session  III 
1 


Have  an  Overview  of  the  Concept: 
Program  Description 

2.  Respond  individually  to  the  criteria 
items  in  Section  C,  using  the  given 

a.  Instructions 

b.  Groundrules 

c.  Questions 

3.  Share  and  discuss  your  responses  within 
a  small  group  and  prepare  a  group  report 

4.  Share  the  group  reports 


12:20-1:00  (40  minutes) 
5  minutes 

10  minutes 


15  minutes 
10  minutes 


LUNCH  BREAK    1:00  -  1:45 


Session  IV 


1:45 


3. 


Have  an  Overview  of  the  Concept: 
Assignment  of  Responsibility  and  Resources 

Respond  individually  to  the  criteria 
items  in  Section  D,  using  the  given 

a.  Instructions 

b.  Groundrules 

c.  Questions 

Share  and  discuss  your  responses  within  a 
small  group  and  prepare  a  group  report 


4.    Share  the  group  reports 


2:40  (55  minutes) 
5  minutes 

15  minutes 


20  minutes 
10  minutes 


RECOMMENDATIONS  FROM  GROUPS    2:40  -  3:00 


STATE  TEC  COUNCIL  EVALUATION  TEAM 
February  8,  1979 
Session  Plan 


10:30  -  10:40  Welcome  and  Introduction 

10:40  -  11:10  Develop  the  Criteria  and  Respond  Individual 

Keeping  in  Mind  Given 

A.  Instructions 

B.  Ground  Rules 

C.  Questions 

11:10  -  11:40  Discuss  the  Criteria  Within  a  Small  Group 

and  Prepare  a  Group  Report 

11:40  -  11:50  Share  the  Group  Reports 


APPENDIX  D-2 
AN  OVERVIEW 


The  proposed  criteria  are  to  be  developed  by  a  selected  group 
of  Florida  educators,  the  Florida  Department  of  Education,  and  the 
members  of  the  State  Council  on  Teacher  Education  Centers  to  assist 
local  teacher  centers  in  evaluation  of  TEC  programs  in  compliance 
with  the  Teacher  Center  Act  of  1973  (Section  231.608,  Florida 
Statutes). 

The  law  provides  for  the  evaluation  of  teacher  education 
center  objectives  and  activities  through  an  annual  report  submitted 
to  the  State  Council  for  Teacher  Education  Centers,  and  also 
establishes  requirements  for  the  State  Council  to  review  the  annual 
reports  and  submit  the  evaluation  to  the  appropriate  authorities. 

Thus,  the  proposed  criteria  are  to  be  developed  exploring  four 
essential  areas  in  TEC  evaluation:    (1)  the  rationale,  (2)  the 
extent  of  collaboration  and  participation,  (3)  the  description  of 
programs  or  activities,  and  (4)  the  adequacy  and  availability  of 
resources. 
Purposes 

There  are  two  purposes  to  be  achieved  through  our  cooperative 
endeavor: 

1.    To  develop  criteria  for  evaluation  of  teacher  education 
centers. 
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2.    To  develop  criteria  for  evaluating  the  evaluation 
activities  of  TECs. 
Objectives 

We  hope  that  the  use  of  the  developed  criteria  will  enable 
the  local  teacher  education  centers  and  the  members  of  the  State 
Council  on  TECs: 

1.  To  identify  reasons  for  TEC  program  evaluation 

2.  To  determine  the  extent  of  collaboration  and  partici- 
pation by  different  role  groups 

3.  To  examine  the  extent  and  adequacy  of  achievement  in 
relation  to  the  TEC  activities 

4.  To  identify  needed  resources  for  TEC  evaluation 

5.  To  develop  recommendations  for  the  improvement  of 
TEC  programs. 

Assumptions 

In  addition  to  the  purposes  and  objectives,  tv/o  basic 
assumptions  may  help  and  guide  our  cooperative  endeavor,  for  TEC 
program  evaluation. 

1.  A  collaborative  effort,  including  teacher  organizations, 
universities,  state  department  of  education,  and  school 
administrations  is  essential  for  the  improvement  of  TEC 
programs. 

2.  Reconceptualizing  the  teacher  education  center  evaluation 
process  is  timely. 
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Activities 

The  task  before  us  is  to  develop  the  proposed  criteria  by 
sharing  experiences,  knowledge  and  ideas  on  TEC  program  evalua- 
tion.   Each  participant  is  expected  to  engage  in  five  activities: 

1.  Have  an  overview  of  the  concepts 

2.  Respond  individually  to  criteria  items 

3.  Share  your  responses  within  a  small  group 

4.  Discuss  how  the  criteria  items  might  be  improved 

5.  Prepare  and  share  small  group  reports 

Four  sessions  are  planned  for  the  development  of  proposed 
criteria.  Each  session  agenda  will  clarify  the  activities  and 
ground  rules  to  be  considered  while  developing  the  criteria. 

Finally,  to  all  who  have  attended,  both  the  visiting  team 
and  the  TEC  Council  members  at  the  site,  I  wish  to  express  my  sincere 
thanks  for  the  splendid  interest  shown  and  the  efforts  you  have  made 
to  give  of  your  valuable  time  in  this  collaborative  effort.  My 
special  appreciation  and  thanks  are  extended  to  my  Guru  (professor) 
Dr.  W.  H.  Drummond,  for  his  untiring  efforts  in  "shaping  me  up"  and 
patience  and  encouragement  offered  during  the  process  of  developing 
the  proposed  criteria.    As  you  all  may  know,  I  am,  after  all,  "a 
foreigner"  --  to  him. 


APPENDIX  D-3 
RATIONALE  FOR  PROPOSED  CRITERIA 

1.  The  proposed  criteria  are  developed  to  help  teacher  education 
center  councils  in  evaluating  their  programs  and  to  facilitate 
evaluation  activities  as  outlined  in  Section  231.608  of  Florida 
Statutes.    These  criteria  are  developed  not  only  to  examine 
the  worth,  effectiveness  and  adequacy  of  TEC  programs,  but 
also  to  obtain  information  useful  for  program  improvement. 
Data  generated  by  these  criteria  should  provide  assistance  to 
those  who  are  responsible  and  interested  in  the  improvement 
and  the  quality  of  TEC  programs. 

2.  An  urgent  need  for  the  development  of  evaluation  criteria  and 
procedures  has  been  emphasized  in  a  report  entitled,  "A  Review 
of  Policy  and  Policy  Implementation"  published  by  the  Department 
of  Education  (May  1977).    It  was  recommended:    the  Commissioner 
of  Education  shound  assign,  as  a  priority  activity,  the  develop- 
ment of  procedures  for  systematic  evaluation  of  teacher  education 
center  programs,  fulfilling  evaluation  functions  outlined  in  the 
Statute. 

3.  An  examination  and  review  of  existing  State  and  TEC  records 
reveals  that  (1)  there  have  been  no  standards  or  criteria  to 
evaluate  teacher  education  centers,  and  (2)  reports  from  TECs 
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emphasize  quantitative  rather  than  qualitative  assessments. 
The  proposed  criteria  are  developed  to  assist  in  developing 
qualitative  measures. 

4.  The  proposed  criteria  call  for  TEC  councils  to  develop 
Statements  of  Policy*  regarding  evaluation.    These  statements 
should  include  at  least  four  requirements  for  evaluation: 

(1)  rationale  for  TEC  evaluation,  (2)  extent  of  collaboration 
and  participation,  (3)  descriptions  of  programs,  and  (4) 
assignment  of  responsibility  and  resources. 

5.  It  is  hoped  that  the  use  of  the  proposed  criteria  for  the 
evaluation  of  TECs  will:    (1)  focus  the  attention  of  educational 
community  to  reexamine  the  purpose  and  the  potential  of  TECs 

in  Florida  and  (2)  stimulate  and  open  communication  among  and 
between  the  groups  having  a  stake  in  TEC  programs  and  activities, 
and  (3)  assist  the  State  Council  on  TECs  in  carrying  out  their 
legislatively  assigned  duties  and  responsibilities. 

« 


*Statements  of  policy  developed  in  organizations  as  continuing 
decisions  about  how  the  organization  will  or  should  function;  they 
may  be  viewed  as  persistent  decisions. 
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